Nov 03 20:10:47 devstack cinder-volume[76254]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 20:10:47 devstack cinder-volume[76254]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 20:10:47 devstack cinder-volume[76254]: we strongly recommend against using it for new projects. Nov 03 20:10:47 devstack cinder-volume[76254]: If you are already using Eventlet, we recommend migrating to a different Nov 03 20:10:47 devstack cinder-volume[76254]: framework. For more detail see Nov 03 20:10:47 devstack cinder-volume[76254]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 20:10:47 devstack cinder-volume[76254]: import eventlet # noqa Nov 03 20:10:49 devstack cinder-volume[76254]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:10:49 devstack cinder-volume[76254]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:10:49 devstack cinder-volume[76254]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:10:50 devstack cinder-volume[76254]: INFO dbcounter [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Registered counter for database cinder Nov 03 20:10:50 devstack cinder-volume[76254]: DEBUG oslo_db.sqlalchemy.engines [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:10:50 devstack cinder-volume[76254]: DEBUG dbcounter [-] [76254] Writer thread running {{(pid=76254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:10:50 devstack cinder-volume[76254]: INFO cinder.rpc [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 20:10:50 devstack cinder-volume[76254]: INFO cinder.rpc [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 20:10:50 devstack cinder-volume[76254]: DEBUG oslo_db.sqlalchemy.engines [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:10:50 devstack cinder-volume[76254]: INFO cinder.volume.manager [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Determined volume DB was empty at startup. Nov 03 20:10:50 devstack cinder-volume[76254]: DEBUG cinder.volume.manager [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76254) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 20:10:50 devstack cinder-volume[76254]: INFO cinder.volume.manager [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 20:10:50 devstack cinder-volume[76254]: WARNING stevedore.named [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 20:10:50 devstack cinder-volume[76254]: WARNING castellan.key_manager [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:10:50 devstack cinder-volume[76254]: WARNING cinder.keymgr.conf_key_mgr [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:10:50 devstack cinder-volume[76254]: DEBUG cinder.volume.drivers.lvm [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76254) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 20:10:50 devstack cinder-volume[76254]: DEBUG oslo_concurrency.processutils [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_concurrency.processutils [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] CMD "cinder-rtstool verify" returned: 0 in 0.440s {{(pid=76254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_db.sqlalchemy.engines [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:10:51 devstack cinder-volume[76254]: INFO cinder.rpc [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 20:10:51 devstack cinder-volume[76254]: INFO cinder.rpc [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 20:10:51 devstack cinder-volume[76254]: WARNING stevedore.named [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 20:10:51 devstack cinder-volume[76254]: WARNING castellan.key_manager [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:10:51 devstack cinder-volume[76254]: INFO cinder.volume.manager [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_db.sqlalchemy.engines [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:10:51 devstack cinder-volume[76254]: INFO oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Starting 1 workers Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Started child 76417 {{(pid=76254) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Full set of CONF: {{(pid=76254) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] ******************************************************************************** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Configuration options gathered from: {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 20:10:51 devstack cinder-volume[76417]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] ================================================================================ {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] allow_availability_zone_fallback = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] allow_compression_on_image_upload = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] allowed_direct_url_schemes = [] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] api_rate_limit = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] auth_strategy = keystone {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] az_cache_duration = 3600 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_availability_zone = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_host = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_name = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_stats_polling_interval = 60 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backup_api_class = cinder.backup.api.API {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backup_name_template = backup-%s {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backup_use_same_host = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backup_use_temp_snapshot = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] chap_password = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] chap_username = {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cinder_internal_tenant_project_id = d991cea872374425b1f3ba401d493953 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cinder_internal_tenant_user_id = 5c274fcd78064a048443e845f09aff2f {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cloned_volume_same_az = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cluster = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] compression_format = gzip {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] compute_api_class = cinder.compute.nova.API {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] config_dir = [] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] config_source = [] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] control_exchange = openstack {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] debug = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] default_availability_zone = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] default_group_type = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] default_volume_type = lvmdriver-1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] disk_geometry = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] driver_client_cert = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] driver_client_cert_key = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] driver_data_namespace = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] driver_ssl_cert_path = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] driver_ssl_cert_verify = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] driver_use_ssl = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] enable_force_upload = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] enable_new_services = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] enable_unsupported_driver = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] enabled_backends = ['lvmdriver-1'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] enforce_multipath_for_image_xfer = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] filter_function = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance_api_insecure = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance_api_ssl_compression = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance_ca_certificates_file = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance_catalog_info = image:glance:publicURL {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance_certfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance_keyfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance_num_retries = 3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance_request_timeout = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] goodness_function = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] graceful_shutdown_timeout = 5 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] group_api_class = cinder.group.api.API {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] host = devstack {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_compress_on_upload = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_conversion_address_space_limit = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_conversion_cpu_limit = 60 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_conversion_disable = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_introspection_address_space_limit = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_introspection_cpu_limit = 60 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_upload_use_cinder_backend = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_upload_use_internal_tenant = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_volume_cache_enabled = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_volume_cache_max_count = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] image_volume_cache_max_size_gb = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76417]: INFO cinder.volume.manager [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 20:10:51 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] init_host_max_objects_retrieval = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] instance_format = [instance: %(uuid)s] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] iscsi_target_flags = {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] iscsi_write_cache = on {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] iser_helper = tgtadm {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] iser_ip_address = 192.168.122.50 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] iser_port = 3260 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] log_color = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] log_config_append = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] log_dir = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] log_file = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] log_options = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] log_rotate_interval = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] log_rotate_interval_type = days {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] log_rotation_type = none {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] max_age = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] max_logfile_count = 30 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] max_logfile_size_mb = 200 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] max_over_subscription_ratio = 20.0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] message_reap_interval = 86400 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] message_ttl = 2592000 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] migration_create_volume_timeout_secs = 300 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] monkey_patch = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] monkey_patch_modules = [] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] my_ip = 192.168.122.50 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] no_snapshot_gb_quota = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] num_iser_scan_tries = 3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] num_shell_tries = 3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] num_volume_device_scan_tries = 3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] nvmeof_conn_info_version = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] nvmet_ns_id = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] nvmet_port_id = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] osapi_max_limit = 1000 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] osapi_volume_ext_list = [] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] osapi_volume_listen = 0.0.0.0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] osapi_volume_listen_port = 8776 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] osapi_volume_use_ssl = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] osapi_volume_workers = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] per_volume_size_limit = -1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] periodic_fuzzy_delay = 60 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] periodic_interval = 60 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] project_id_regex = [0-9a-f\-]+ {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] public_endpoint = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] publish_errors = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] quota_backup_gigabytes = 1000 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] quota_backups = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] quota_gigabytes = 1000 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] quota_groups = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] quota_snapshots = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] quota_volumes = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] rate_limit_burst = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] rate_limit_except_level = CRITICAL {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] rate_limit_interval = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] reinit_driver_count = 3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] replication_device = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] report_discard_supported = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] report_interval = 120 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] reservation_clean_interval = 86400 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] reservation_expire = 86400 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] reserved_image_namespaces = [] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] reserved_percentage = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] rpc_response_timeout = 120 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] run_external_periodic_tasks = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] scst_target_driver = iscsi {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] scst_target_iqn_name = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_down_time = 720 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] shell_completion = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] snapshot_name_template = snapshot-%s {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] snapshot_same_host = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] split_loggers = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] state_path = /opt/stack/data/cinder {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] storage_availability_zone = nova {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] storage_protocol = iSCSI {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] syslog_log_facility = LOG_USER {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] target_helper = lioadm {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] target_ip_address = 192.168.122.50 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] target_port = 3260 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] target_protocol = iscsi {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] target_secondary_ip_addresses = [] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] trace_flags = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] transfer_api_class = cinder.transfer.api.API {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] transport_url = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] until_refresh = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] use_chap_auth = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] use_default_quota_class = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] use_journal = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] use_json = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] use_multipath_for_image_xfer = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] use_stderr = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] use_syslog = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] verify_glance_signatures = enabled {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_api_class = cinder.volume.api.API {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_backend_name = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_clear = zero {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_clear_ionice = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_clear_size = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_copy_bps_limit = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_dd_blocksize = 1M {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_name_template = volume-%s {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_service_inithost_offload = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volume_usage_audit_period = month {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] zoning_mode = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_concurrency.disable_process_locking = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.auth_section = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.auth_type = password {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.auth_version = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.cache = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.certfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.delay_auth_decision = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.http_connect_timeout = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.include_service_catalog = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.insecure = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.interface = public {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.keyfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_password = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:51 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcache_username = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.region_name = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.service_token_roles_required = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.service_type = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.token_cache_time = 300 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.backend = dogpile.cache.null {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.backend_argument = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.backend_expiration_time = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.config_prefix = cache.oslo {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.debug_cache_backend = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.enable_retry_client = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.enable_socket_keepalive = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.enabled = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.expiration_time = 600 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.hashclient_retry_attempts = 2 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.memcache_dead_retry = 300 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.memcache_pool_maxsize = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.memcache_sasl_enabled = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.password = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.proxies = [] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.redis_db = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.redis_sentinel_service_name = mymaster {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.redis_server = localhost:6379 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.retry_attempts = 2 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.retry_delay = 0.0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.socket_keepalive_count = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.socket_keepalive_idle = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.socket_keepalive_interval = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.socket_timeout = 1.0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.tls_allowed_ciphers = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.tls_cafile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.tls_certfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.tls_enabled = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.tls_keyfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cache.username = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] coordination.backend_url = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.asyncio_connection = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.asyncio_slave_connection = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.backend = sqlalchemy {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.connection = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.connection_debug = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.connection_parameters = {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.connection_recycle_time = 3600 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.connection_trace = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.db_inc_retry_interval = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.db_max_retries = 20 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.db_max_retry_interval = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.db_retry_interval = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.max_overflow = 50 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.max_pool_size = 5 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.max_retries = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.mysql_wsrep_sync_wait = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.pool_timeout = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.retry_interval = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.slave_connection = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.sqlite_synchronous = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.synchronous_reader = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] database.use_db_reconnect = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_tracing.insecure = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler.connection_string = messaging:// {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler.enabled = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler.es_doc_type = notification {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler.es_scroll_size = 10000 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler.es_scroll_time = 2m {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler.filter_error_trace = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler.hmac_keys = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler.sentinel_service_name = mymaster {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler.socket_timeout = 0.1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler.trace_requests = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler.trace_sqlalchemy = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler_jaeger.process_tags = {} {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler_jaeger.service_name_prefix = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] profiler_otlp.service_name_prefix = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_policy.enforce_new_defaults = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_policy.policy_default_rule = default {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_policy.policy_file = policy.yaml {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_policy.remote_timeout = 60.0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] privsep_osbrick.group = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] privsep_osbrick.helper_command = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] privsep_osbrick.user = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cinder_sys_admin.group = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cinder_sys_admin.helper_command = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] cinder_sys_admin.user = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.auth_section = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.auth_type = password {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.cafile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.certfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.collect_timing = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.insecure = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.keyfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.send_service_user_token = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.split_loggers = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.timeout = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.tls_ciphers = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] service_user.tls_min_version = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.auth_section = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.auth_type = password {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.certfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.collect_timing = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.insecure = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.keyfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.region_name = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.split_loggers = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.timeout = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.tls_ciphers = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack sudo[76421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 20:10:51 devstack sudo[76421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] glance.tls_min_version = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.backend_availability_zone = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.chap_password = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.chap_username = {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.disk_geometry = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.driver_client_cert = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.driver_client_cert_key = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.driver_data_namespace = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.driver_use_ssl = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.enable_unsupported_driver = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.extra_capabilities = {} {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.filter_function = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.goodness_function = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.iscsi_target_flags = {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.iscsi_write_cache = on {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.iser_helper = tgtadm {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.iser_port = 3260 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.lvm_mirrors = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.lvm_share_target = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.lvm_type = auto {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.num_shell_tries = 3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.nvmet_port_id = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.replication_device = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.report_discard_supported = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.reserved_percentage = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.scst_target_driver = iscsi {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.scst_target_iqn_name = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.storage_protocol = iSCSI {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.target_helper = tgtadm {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.target_port = 3260 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.target_protocol = iscsi {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.trace_flags = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.unique_fqdn_network = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.use_chap_auth = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.volume_backend_name = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.volume_clear = zero {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.volume_clear_ionice = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.volume_clear_size = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.volume_group = cinder-volumes {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_reports.file_event_handler = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_reports.log_dir = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.backend_availability_zone = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.backend_host = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.chap_password = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.chap_username = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.chiscsi_conf = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.disk_geometry = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.driver_client_cert = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.driver_data_namespace = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.driver_use_ssl = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.extra_capabilities = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.filter_function = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.goodness_function = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.iser_helper = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.iser_ip_address = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.iser_port = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.iser_target_prefix = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.lvm_conf_file = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.lvm_mirrors = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.lvm_share_target = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.lvm_type = auto {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.num_shell_tries = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.nvmet_port_id = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.replication_device = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.report_discard_supported = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.reserved_percentage = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.scst_target_driver = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.storage_protocol = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.target_helper = lioadm {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.target_ip_address = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.target_port = 3260 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.target_protocol = iscsi {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.trace_flags = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.use_chap_auth = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.volume_clear = zero {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.volume_clear_size = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] lvmdriver-1.volumes_dir = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.ssl = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.ssl_version = {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_notifications.driver = [] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_notifications.retry = -1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] oslo_messaging_notifications.transport_url = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] key_manager.fixed_key = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.barbican_api_version = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.barbican_endpoint = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.barbican_endpoint_type = public {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.barbican_region_name = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.cafile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.certfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.collect_timing = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.insecure = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.keyfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.number_of_retries = 60 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.retry_delay = 1 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.send_service_user_token = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.split_loggers = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.timeout = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.tls_ciphers = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.tls_min_version = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.verify_ssl = True {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican.verify_ssl_path = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican_service_user.auth_section = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican_service_user.auth_type = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican_service_user.cafile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican_service_user.certfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican_service_user.collect_timing = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican_service_user.insecure = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican_service_user.keyfile = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican_service_user.split_loggers = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican_service_user.timeout = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican_service_user.tls_ciphers = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] barbican_service_user.tls_min_version = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.approle_role_id = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.approle_secret_id = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.auth_method = approle {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.auth_path = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.kv_mountpoint = secret {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.kv_path = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.kv_version = 2 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.namespace = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.root_token_id = **** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.ssl_ca_crt_file = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.timeout = 60.0 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.token_file = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.token_role = None {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.use_ssl = False {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:10:51 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] ******************************************************************************** {{(pid=76254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 20:10:52 devstack sudo[76421]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:52 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.378s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:52 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:52 devstack sudo[76425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:10:52 devstack sudo[76425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:52 devstack sudo[76425]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:52 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.270s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:52 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:10:52 devstack cinder-volume[76417]: INFO cinder.brick.local_dev.lvm [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 20:10:52 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:52 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:52 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:52 devstack sudo[76429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:10:52 devstack sudo[76429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:52 devstack sudo[76429]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:52 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:52 devstack cinder-volume[76417]: DEBUG cinder.brick.local_dev.lvm [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76417) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 20:10:52 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:52 devstack sudo[76492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:10:52 devstack sudo[76492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:53 devstack sudo[76492]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:53 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:53 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:53 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:53 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:53 devstack sudo[76712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:10:53 devstack sudo[76712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:53 devstack sudo[76712]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:53 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:53 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:53 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:53 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:53 devstack sudo[76803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 20:10:53 devstack sudo[76803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:53 devstack sudo[76803]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:53 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:53 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:53 devstack sudo[76891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:10:53 devstack sudo[76891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:54 devstack sudo[76891]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:54 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:54 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:54 devstack sudo[76971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:10:54 devstack sudo[76971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:54 devstack sudo[76971]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:54 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:54 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:54 devstack sudo[77043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:10:54 devstack sudo[77043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:54 devstack sudo[77043]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:54 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:54 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:54 devstack sudo[77051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:10:54 devstack sudo[77051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:55 devstack sudo[77051]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.313s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:55 devstack sudo[77132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:10:55 devstack sudo[77132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:55 devstack sudo[77132]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:55 devstack cinder-volume[76417]: INFO cinder.volume.drivers.lvm [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:55 devstack sudo[77142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:10:55 devstack sudo[77142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:55 devstack sudo[77142]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG cinder.volume.drivers.lvm [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Updating volume stats {{(pid=76417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:55 devstack sudo[77225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:10:55 devstack sudo[77225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:55 devstack sudo[77225]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:55 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:55 devstack sudo[77228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:10:55 devstack sudo[77228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:56 devstack sudo[77228]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:56 devstack sudo[77237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:10:56 devstack sudo[77237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:56 devstack sudo[77237]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:56 devstack sudo[77240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:10:56 devstack sudo[77240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:56 devstack sudo[77240]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:56 devstack cinder-volume[76417]: INFO cinder.volume.driver [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG cinder.volume.driver [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76417) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG oslo_db.sqlalchemy.engines [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG dbcounter [-] [76417] Writer thread running {{(pid=76417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG cinder.db.api [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Building query based on filter {{(pid=76417) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG cinder.image.image_utils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76417) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 20:10:56 devstack cinder-volume[76417]: INFO cinder.keymgr.migration [None req-3a34c10e-d976-488a-858f-5dee253a03c8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG cinder.volume.drivers.lvm [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Updating volume stats {{(pid=76417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:10:56 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:56 devstack sudo[77245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:10:56 devstack sudo[77245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:57 devstack sudo[77245]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:57 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:57 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:57 devstack sudo[77248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:10:57 devstack sudo[77248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:57 devstack sudo[77248]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:57 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:57 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:57 devstack sudo[77251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:10:57 devstack sudo[77251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:57 devstack sudo[77251]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:57 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:57 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:57 devstack sudo[77254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:10:57 devstack sudo[77254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:57 devstack sudo[77254]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:57 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:57 devstack cinder-volume[76417]: DEBUG cinder.manager [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Notifying Schedulers of capabilities ... {{(pid=76417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:10:57 devstack cinder-volume[76417]: INFO cinder.volume.manager [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Driver initialization completed successfully. Nov 03 20:10:57 devstack cinder-volume[76417]: INFO cinder.manager [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Initiating service 2 cleanup Nov 03 20:10:57 devstack cinder-volume[76417]: INFO cinder.manager [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Service 2 cleanup completed. Nov 03 20:10:57 devstack cinder-volume[76417]: DEBUG cinder.service [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Creating RPC server for service cinder-volume {{(pid=76417) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 20:10:57 devstack cinder-volume[76417]: DEBUG cinder.service [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76417) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 20:10:58 devstack cinder-volume[76417]: INFO cinder.volume.manager [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 20:10:58 devstack cinder-volume[76417]: DEBUG cinder.volume.drivers.lvm [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Updating volume stats {{(pid=76417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:10:58 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:58 devstack sudo[77259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:10:58 devstack sudo[77259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:58 devstack sudo[77259]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:58 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:58 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:58 devstack sudo[77262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:10:58 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:58 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:58 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:58 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:58 devstack sudo[77266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:10:58 devstack sudo[77266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:58 devstack sudo[77266]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:58 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:58 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:10:58 devstack sudo[77269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:10:58 devstack sudo[77269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:10:59 devstack sudo[77269]: pam_unix(sudo:session): session closed for user root Nov 03 20:10:59 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:10:59 devstack cinder-volume[76417]: INFO cinder.volume.manager [None req-caa98f1b-47e1-481a-b55b-cc88eb2f3f10 None None] Driver post RPC initialization completed successfully. Nov 03 20:11:01 devstack cinder-volume[76254]: DEBUG dbcounter [-] [76254] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:11:09 devstack cinder-volume[76417]: DEBUG dbcounter [-] [76417] Writing DB stats cinder:SELECT=2 {{(pid=76417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:11:09 devstack cinder-volume[76417]: DEBUG dbcounter [-] [76417] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:11:47 devstack cinder-volume[76417]: DEBUG oslo_service.periodic_task [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running periodic task VolumeManager._thread_info {{(pid=76417) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:11:47 devstack cinder-volume[76417]: DEBUG cinder.volume.manager [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] thread count: 6 {{(pid=76417) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:11:47 devstack cinder-volume[76417]: DEBUG cinder.volume.manager [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] thread info: [<_MainThread(MainThread, started 132204784263296)>, , , , , ] {{(pid=76417) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:12:47 devstack cinder-volume[76417]: DEBUG oslo_service.periodic_task [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76417) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:12:47 devstack cinder-volume[76417]: DEBUG cinder.volume.drivers.lvm [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Updating volume stats {{(pid=76417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:12:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:12:47 devstack sudo[82401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:12:47 devstack sudo[82401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:12:47 devstack sudo[82401]: pam_unix(sudo:session): session closed for user root Nov 03 20:12:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:12:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:12:47 devstack sudo[82404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:12:47 devstack sudo[82404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:12:47 devstack sudo[82404]: pam_unix(sudo:session): session closed for user root Nov 03 20:12:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:12:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:12:47 devstack sudo[82407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:12:47 devstack sudo[82407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:12:47 devstack sudo[82407]: pam_unix(sudo:session): session closed for user root Nov 03 20:12:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:12:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:12:47 devstack sudo[82410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:12:47 devstack sudo[82410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:12:48 devstack sudo[82410]: pam_unix(sudo:session): session closed for user root Nov 03 20:12:48 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:12:48 devstack cinder-volume[76417]: DEBUG cinder.manager [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Notifying Schedulers of capabilities ... {{(pid=76417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:12:48 devstack cinder-volume[76417]: DEBUG oslo_service.periodic_task [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running periodic task VolumeManager._thread_info {{(pid=76417) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:12:48 devstack cinder-volume[76417]: DEBUG cinder.volume.manager [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] thread count: 6 {{(pid=76417) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:12:48 devstack cinder-volume[76417]: DEBUG cinder.volume.manager [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] thread info: [<_MainThread(MainThread, started 132204784263296)>, , , , , ] {{(pid=76417) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:13:09 devstack cinder-volume[76417]: DEBUG dbcounter [-] [76417] Writing DB stats cinder:SELECT=1 {{(pid=76417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:13:09 devstack cinder-volume[76417]: DEBUG dbcounter [-] [76417] Writing DB stats cinder:UPDATE=1 {{(pid=76417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:13:47 devstack cinder-volume[76417]: DEBUG oslo_service.periodic_task [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76417) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:13:47 devstack cinder-volume[76417]: DEBUG cinder.volume.drivers.lvm [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Updating volume stats {{(pid=76417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:13:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:13:47 devstack sudo[84342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:13:47 devstack sudo[84342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:13:47 devstack sudo[84342]: pam_unix(sudo:session): session closed for user root Nov 03 20:13:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:13:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:13:47 devstack sudo[84365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:13:47 devstack sudo[84365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:13:47 devstack sudo[84365]: pam_unix(sudo:session): session closed for user root Nov 03 20:13:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:13:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:13:47 devstack sudo[84368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:13:47 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:13:47 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root Nov 03 20:13:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:13:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:13:47 devstack sudo[84382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:13:47 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:13:48 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root Nov 03 20:13:48 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:13:48 devstack cinder-volume[76417]: DEBUG cinder.manager [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Notifying Schedulers of capabilities ... {{(pid=76417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:13:48 devstack cinder-volume[76417]: DEBUG oslo_service.periodic_task [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running periodic task VolumeManager._thread_info {{(pid=76417) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:13:48 devstack cinder-volume[76417]: DEBUG cinder.volume.manager [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] thread count: 6 {{(pid=76417) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:13:48 devstack cinder-volume[76417]: DEBUG cinder.volume.manager [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] thread info: [<_MainThread(MainThread, started 132204784263296)>, , , , , ] {{(pid=76417) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:14:47 devstack cinder-volume[76417]: DEBUG oslo_service.periodic_task [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76417) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:14:47 devstack cinder-volume[76417]: DEBUG cinder.volume.drivers.lvm [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Updating volume stats {{(pid=76417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:14:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:14:47 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:14:47 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:14:47 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Nov 03 20:14:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:14:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:14:47 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:14:47 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:14:47 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Nov 03 20:14:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:14:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:14:47 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:14:47 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:14:47 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Nov 03 20:14:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:14:47 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:14:47 devstack sudo[85764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:14:47 devstack sudo[85764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:14:48 devstack sudo[85764]: pam_unix(sudo:session): session closed for user root Nov 03 20:14:48 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:14:48 devstack cinder-volume[76417]: DEBUG cinder.manager [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Notifying Schedulers of capabilities ... {{(pid=76417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:14:48 devstack cinder-volume[76417]: DEBUG oslo_service.periodic_task [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] Running periodic task VolumeManager._thread_info {{(pid=76417) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:14:48 devstack cinder-volume[76417]: DEBUG cinder.volume.manager [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] thread count: 6 {{(pid=76417) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:14:48 devstack cinder-volume[76417]: DEBUG cinder.volume.manager [None req-f00afe23-99a5-495c-b0ee-7e5cf718970f None None] thread info: [<_MainThread(MainThread, started 132204784263296)>, , , , , ] {{(pid=76417) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:15:09 devstack cinder-volume[76417]: DEBUG dbcounter [-] [76417] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:15:20 devstack cinder-volume[76254]: INFO oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Caught SIGTERM, stopping children Nov 03 20:15:20 devstack cinder-volume[76254]: DEBUG oslo_concurrency.lockutils [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Acquiring lock "singleton_lock" {{(pid=76254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:15:20 devstack cinder-volume[76254]: DEBUG oslo_concurrency.lockutils [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Acquired lock "singleton_lock" {{(pid=76254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:15:20 devstack cinder-volume[76254]: DEBUG oslo_concurrency.lockutils [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Releasing lock "singleton_lock" {{(pid=76254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:15:20 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Stop services. {{(pid=76254) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 20:15:20 devstack cinder-volume[76254]: DEBUG oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Killing children. {{(pid=76254) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 20:15:20 devstack cinder-volume[76254]: INFO oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Waiting on 1 children to exit Nov 03 20:15:23 devstack cinder-volume[76417]: DEBUG oslo_concurrency.lockutils [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Acquiring lock "singleton_lock" {{(pid=76417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:15:23 devstack cinder-volume[76417]: DEBUG oslo_concurrency.lockutils [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Acquired lock "singleton_lock" {{(pid=76417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:15:23 devstack cinder-volume[76417]: DEBUG oslo_concurrency.lockutils [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Releasing lock "singleton_lock" {{(pid=76417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:15:23 devstack cinder-volume[76417]: WARNING amqp [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 20:15:23 devstack cinder-volume[76417]: WARNING amqp [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 20:15:23 devstack cinder-volume[76254]: INFO oslo_service.backend._eventlet.service [None req-33a77594-fc7d-499d-aefc-04a9752173dd None None] Child 76417 exited with status 0 Nov 03 20:15:23 devstack cinder-volume[86509]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 20:15:23 devstack cinder-volume[86509]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 20:15:23 devstack cinder-volume[86509]: we strongly recommend against using it for new projects. Nov 03 20:15:23 devstack cinder-volume[86509]: If you are already using Eventlet, we recommend migrating to a different Nov 03 20:15:23 devstack cinder-volume[86509]: framework. For more detail see Nov 03 20:15:23 devstack cinder-volume[86509]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 20:15:23 devstack cinder-volume[86509]: import eventlet # noqa Nov 03 20:15:25 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:15:25 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:15:25 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:15:26 devstack cinder-volume[86509]: INFO dbcounter [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Registered counter for database cinder Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_db.sqlalchemy.engines [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG dbcounter [-] [86509] Writer thread running {{(pid=86509) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:15:26 devstack cinder-volume[86509]: INFO cinder.rpc [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 20:15:26 devstack cinder-volume[86509]: INFO cinder.rpc [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_db.sqlalchemy.engines [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:15:26 devstack cinder-volume[86509]: INFO cinder.volume.manager [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Determined volume DB was empty at startup. Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG cinder.volume.manager [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86509) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 20:15:26 devstack cinder-volume[86509]: INFO cinder.volume.manager [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 20:15:26 devstack cinder-volume[86509]: WARNING stevedore.named [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 20:15:26 devstack cinder-volume[86509]: WARNING castellan.key_manager [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:15:26 devstack cinder-volume[86509]: WARNING cinder.keymgr.conf_key_mgr [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:15:26 devstack cinder-volume[86509]: INFO cinder.volume.manager [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_db.sqlalchemy.engines [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:15:26 devstack cinder-volume[86509]: INFO oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Starting 1 workers Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Started child 86727 {{(pid=86509) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Full set of CONF: {{(pid=86509) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] ******************************************************************************** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Configuration options gathered from: {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] ================================================================================ {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] allow_availability_zone_fallback = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] allow_compression_on_image_upload = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] allowed_direct_url_schemes = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] api_rate_limit = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] auth_strategy = keystone {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_availability_zone = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_host = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86727]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_stats_polling_interval = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backup_api_class = cinder.backup.api.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backup_name_template = backup-%s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backup_use_same_host = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backup_use_temp_snapshot = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] chap_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] chap_username = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cinder_internal_tenant_project_id = d991cea872374425b1f3ba401d493953 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cinder_internal_tenant_user_id = 5c274fcd78064a048443e845f09aff2f {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cluster = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] compression_format = gzip {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] compute_api_class = cinder.compute.nova.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] config_dir = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] config_source = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] control_exchange = openstack {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] debug = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] default_availability_zone = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] default_group_type = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] default_volume_type = QuobyteHD {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] disk_geometry = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] driver_client_cert = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] driver_client_cert_key = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] driver_data_namespace = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] driver_ssl_cert_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] driver_ssl_cert_verify = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] driver_use_ssl = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] enable_new_services = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] enable_unsupported_driver = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] enabled_backends = ['QuobyteHD'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] enforce_multipath_for_image_xfer = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] filter_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance_api_insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance_api_ssl_compression = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance_ca_certificates_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance_catalog_info = image:glance:publicURL {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance_certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance_keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance_num_retries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance_request_timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] goodness_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] graceful_shutdown_timeout = 5 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] group_api_class = cinder.group.api.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] host = devstack {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_compress_on_upload = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_conversion_address_space_limit = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_conversion_cpu_limit = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_conversion_disable = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_introspection_address_space_limit = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_introspection_cpu_limit = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_upload_use_cinder_backend = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_upload_use_internal_tenant = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_volume_cache_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_volume_cache_max_count = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] image_volume_cache_max_size_gb = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] init_host_max_objects_retrieval = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] instance_format = [instance: %(uuid)s] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] iscsi_target_flags = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] iscsi_write_cache = on {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] iser_helper = tgtadm {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] iser_ip_address = 192.168.122.50 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] iser_port = 3260 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] log_color = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] log_config_append = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] log_dir = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] log_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] log_options = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] log_rotate_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] log_rotate_interval_type = days {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] log_rotation_type = none {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] max_age = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] max_logfile_count = 30 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86727]: INFO cinder.volume.manager [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 20:15:26 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.remotefs [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86727) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] max_logfile_size_mb = 200 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] max_over_subscription_ratio = 20.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] message_reap_interval = 86400 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] message_ttl = 2592000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] migration_create_volume_timeout_secs = 300 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] monkey_patch = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] monkey_patch_modules = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] my_ip = 192.168.122.50 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] no_snapshot_gb_quota = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] num_iser_scan_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] num_shell_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] num_volume_device_scan_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] nvmeof_conn_info_version = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] nvmet_ns_id = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] nvmet_port_id = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] osapi_max_limit = 1000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] osapi_volume_ext_list = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] osapi_volume_listen_port = 8776 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] osapi_volume_use_ssl = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] osapi_volume_workers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] per_volume_size_limit = -1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] periodic_fuzzy_delay = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] periodic_interval = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] public_endpoint = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] publish_errors = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] quota_backup_gigabytes = 1000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] quota_backups = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] quota_gigabytes = 1000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] quota_groups = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] quota_snapshots = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] quota_volumes = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] rate_limit_burst = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] rate_limit_except_level = CRITICAL {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] rate_limit_interval = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] reinit_driver_count = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] replication_device = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] report_discard_supported = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] report_interval = 120 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] reservation_clean_interval = 86400 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] reservation_expire = 86400 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] reserved_image_namespaces = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] reserved_percentage = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] rpc_response_timeout = 120 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] run_external_periodic_tasks = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] scst_target_driver = iscsi {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] scst_target_iqn_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_down_time = 720 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] shell_completion = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] snapshot_name_template = snapshot-%s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] split_loggers = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] state_path = /opt/stack/data/cinder {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] storage_availability_zone = nova {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] storage_protocol = iSCSI {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] syslog_log_facility = LOG_USER {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] target_helper = lioadm {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] target_ip_address = 192.168.122.50 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] target_port = 3260 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] target_protocol = iscsi {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] target_secondary_ip_addresses = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] trace_flags = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] transport_url = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] until_refresh = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] use_chap_auth = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] use_default_quota_class = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] use_journal = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] use_json = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] use_multipath_for_image_xfer = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] use_stderr = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] use_syslog = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] verify_glance_signatures = enabled {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_api_class = cinder.volume.api.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_backend_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_clear = zero {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_clear_ionice = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_clear_size = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_copy_bps_limit = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_dd_blocksize = 1M {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_name_template = volume-%s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_service_inithost_offload = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volume_usage_audit_period = month {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] zoning_mode = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_concurrency.disable_process_locking = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.auth_section = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.auth_type = password {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.auth_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.cache = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.include_service_catalog = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.interface = public {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:26 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcache_username = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.region_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.service_type = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.backend = dogpile.cache.null {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.backend_argument = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.backend_expiration_time = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.config_prefix = cache.oslo {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.debug_cache_backend = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.enable_retry_client = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.enable_socket_keepalive = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.expiration_time = 600 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.hashclient_retry_attempts = 2 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.memcache_dead_retry = 300 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86727) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 20:15:27 devstack cinder-volume[86727]: WARNING cinder.volume.drivers.quobyte [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 20:15:27 devstack cinder-volume[86727]: WARNING cinder.volume.drivers.quobyte [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Running cmd (subprocess): mount.quobyte {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.memcache_pool_maxsize = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.memcache_sasl_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.proxies = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.redis_db = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.redis_server = localhost:6379 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.retry_attempts = 2 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.retry_delay = 0.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.socket_keepalive_count = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.socket_keepalive_idle = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.socket_keepalive_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.socket_timeout = 1.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.tls_allowed_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.tls_cafile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.tls_certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.tls_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.tls_keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cache.username = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] coordination.backend_url = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.asyncio_connection = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.asyncio_slave_connection = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.backend = sqlalchemy {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.connection = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.connection_debug = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.connection_parameters = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.connection_recycle_time = 3600 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.connection_trace = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.db_inc_retry_interval = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.db_max_retries = 20 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.db_max_retry_interval = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.db_retry_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.max_overflow = 50 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.max_pool_size = 5 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.max_retries = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.mysql_wsrep_sync_wait = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.pool_timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.retry_interval = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.slave_connection = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.sqlite_synchronous = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.synchronous_reader = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] database.use_db_reconnect = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_tracing.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler.connection_string = messaging:// {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler.enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler.es_doc_type = notification {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler.es_scroll_size = 10000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler.es_scroll_time = 2m {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler.filter_error_trace = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler.hmac_keys = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler.sentinel_service_name = mymaster {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler.socket_timeout = 0.1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler.trace_requests = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler.trace_sqlalchemy = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler_jaeger.process_tags = {} {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler_jaeger.service_name_prefix = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] profiler_otlp.service_name_prefix = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_policy.enforce_new_defaults = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_policy.policy_default_rule = default {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_policy.policy_file = policy.yaml {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] privsep_osbrick.group = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] privsep_osbrick.helper_command = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] privsep_osbrick.user = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cinder_sys_admin.group = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cinder_sys_admin.helper_command = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] cinder_sys_admin.user = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.auth_section = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.auth_type = password {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.cafile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.collect_timing = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.send_service_user_token = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.split_loggers = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.tls_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] service_user.tls_min_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.auth_section = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.auth_type = password {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.collect_timing = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.region_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.split_loggers = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.tls_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] glance.tls_min_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.backend_availability_zone = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.chap_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.chap_username = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.disk_geometry = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.driver_client_cert = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.driver_client_cert_key = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.driver_data_namespace = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.driver_use_ssl = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.extra_capabilities = {} {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.filter_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.goodness_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.iscsi_target_flags = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.iscsi_write_cache = on {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.iser_helper = tgtadm {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.iser_port = 3260 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nas_host = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nas_login = admin {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nas_mount_options = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nas_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nas_private_key = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nas_share_path = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.num_shell_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.quobyte_volume_url = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.replication_device = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.report_discard_supported = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.reserved_percentage = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.target_helper = tgtadm {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.target_port = 3260 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.target_protocol = iscsi {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.trace_flags = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.unique_fqdn_network = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.use_chap_auth = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.volume_backend_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.volume_clear = zero {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.volume_clear_ionice = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.volume_clear_size = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_reports.file_event_handler = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_reports.log_dir = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.backend_availability_zone = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.backend_host = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.chap_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.chap_username = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.chiscsi_conf = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.disk_geometry = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.driver_client_cert = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.driver_data_namespace = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.driver_use_ssl = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.extra_capabilities = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.filter_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.goodness_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.iser_helper = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.iser_ip_address = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.iser_port = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.iser_target_prefix = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nas_host = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nas_login = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nas_mount_options = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nas_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nas_private_key = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nas_share_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nas_ssh_port = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.num_shell_tries = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.nvmet_port_id = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.replication_device = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.report_discard_supported = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.reserved_percentage = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.scst_target_driver = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.storage_protocol = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.target_helper = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.target_ip_address = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.target_port = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.target_prefix = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.target_protocol = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.trace_flags = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.use_chap_auth = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.volume_clear = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.volume_clear_size = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] QuobyteHD.volumes_dir = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.ssl = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_notifications.driver = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_notifications.retry = -1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] key_manager.fixed_key = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.barbican_api_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.barbican_endpoint = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack quobyte-client[86729]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 20:15:27 devstack quobyte-client[86729]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.barbican_endpoint_type = public {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.barbican_region_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.cafile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.collect_timing = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.number_of_retries = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.retry_delay = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.send_service_user_token = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.split_loggers = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.tls_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.tls_min_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.verify_ssl = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican.verify_ssl_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] CMD "mount.quobyte" returned: 1 in 0.208s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican_service_user.auth_section = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican_service_user.auth_type = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican_service_user.cafile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican_service_user.certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican_service_user.collect_timing = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican_service_user.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican_service_user.keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican_service_user.split_loggers = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican_service_user.timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican_service_user.tls_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=86727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] barbican_service_user.tls_min_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.approle_role_id = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.approle_secret_id = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86727]: INFO cinder.volume.drivers.quobyte [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb ... Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.auth_method = approle {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.auth_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 -c /etc/quobyte/client-cinder.cfg {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.kv_mountpoint = secret {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.kv_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.kv_version = 2 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.namespace = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.root_token_id = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.ssl_ca_crt_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.timeout = 60.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.token_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.token_role = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.use_ssl = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:27 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] ******************************************************************************** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 20:15:27 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 -c /etc/quobyte/client-cinder.cfg Nov 03 20:15:27 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:27 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.409s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:27 devstack cinder-volume[86727]: INFO cinder.volume.drivers.quobyte [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb succeeded Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=86727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.423s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:27 devstack sudo[86836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:15:27 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:27 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.233s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:27 devstack cinder-volume[86727]: INFO cinder.volume.driver [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG cinder.volume.driver [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6631889343262, 'free_capacity_gb': 1773.6631889343262, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86727) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG oslo_db.sqlalchemy.engines [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86727) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:15:27 devstack cinder-volume[86727]: DEBUG dbcounter [-] [86727] Writer thread running {{(pid=86727) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG cinder.db.api [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Building query based on filter {{(pid=86727) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG cinder.image.image_utils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86727) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 20:15:28 devstack cinder-volume[86727]: INFO cinder.keymgr.migration [None req-da5c7556-dd97-4e59-bf15-ded8961279b1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=86727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=86727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:28 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:15:28 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:28 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.227s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG cinder.manager [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Notifying Schedulers of capabilities ... {{(pid=86727) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:15:28 devstack cinder-volume[86727]: INFO cinder.volume.manager [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Driver initialization completed successfully. Nov 03 20:15:28 devstack cinder-volume[86727]: INFO cinder.manager [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Initiating service 3 cleanup Nov 03 20:15:28 devstack cinder-volume[86727]: INFO cinder.manager [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Service 3 cleanup completed. Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG cinder.service [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Creating RPC server for service cinder-volume {{(pid=86727) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG cinder.service [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86727) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 20:15:28 devstack cinder-volume[86727]: INFO cinder.volume.manager [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=86727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=86727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:28 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:15:28 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:28 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:28 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.273s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:28 devstack cinder-volume[86727]: INFO cinder.volume.manager [None req-504d17f7-9eb2-407c-8b21-805ba7805ec0 None None] Driver post RPC initialization completed successfully. Nov 03 20:15:33 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-121a596a-4174-4b24-a8e7-680f8e47af9a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:15:33 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-121a596a-4174-4b24-a8e7-680f8e47af9a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:15:33 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-121a596a-4174-4b24-a8e7-680f8e47af9a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=86727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:15:33 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-121a596a-4174-4b24-a8e7-680f8e47af9a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=86727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:15:33 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-121a596a-4174-4b24-a8e7-680f8e47af9a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:15:33 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-121a596a-4174-4b24-a8e7-680f8e47af9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:33 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:15:33 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:33 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:33 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-121a596a-4174-4b24-a8e7-680f8e47af9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.243s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:33 devstack cinder-volume[86727]: DEBUG cinder.manager [None req-121a596a-4174-4b24-a8e7-680f8e47af9a None None] Notifying Schedulers of capabilities ... {{(pid=86727) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:15:34 devstack cinder-volume[86509]: INFO oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Caught SIGTERM, stopping children Nov 03 20:15:34 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Acquiring lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:15:34 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Acquired lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:15:34 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Releasing lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:15:34 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Stop services. {{(pid=86509) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 20:15:34 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Killing children. {{(pid=86509) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 20:15:34 devstack cinder-volume[86509]: INFO oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Waiting on 1 children to exit Nov 03 20:15:36 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Acquiring lock "singleton_lock" {{(pid=86727) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:15:36 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Acquired lock "singleton_lock" {{(pid=86727) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:15:36 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Releasing lock "singleton_lock" {{(pid=86727) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:15:36 devstack cinder-volume[86727]: WARNING amqp [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 20:15:36 devstack cinder-volume[86727]: WARNING amqp [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 20:15:36 devstack cinder-volume[86509]: INFO oslo_service.backend._eventlet.service [None req-50c10389-76bd-49d7-bcfc-01345a71f91d None None] Child 86727 exited with status 0 Nov 03 20:15:37 devstack cinder-volume[87051]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 20:15:37 devstack cinder-volume[87051]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 20:15:37 devstack cinder-volume[87051]: we strongly recommend against using it for new projects. Nov 03 20:15:37 devstack cinder-volume[87051]: If you are already using Eventlet, we recommend migrating to a different Nov 03 20:15:37 devstack cinder-volume[87051]: framework. For more detail see Nov 03 20:15:37 devstack cinder-volume[87051]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 20:15:37 devstack cinder-volume[87051]: import eventlet # noqa Nov 03 20:15:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87051) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:15:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87051) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:15:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87051) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:15:41 devstack cinder-volume[87051]: INFO dbcounter [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Registered counter for database cinder Nov 03 20:15:41 devstack cinder-volume[87051]: DEBUG oslo_db.sqlalchemy.engines [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87051) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:15:41 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writer thread running {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:15:41 devstack cinder-volume[87051]: INFO cinder.rpc [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 20:15:41 devstack cinder-volume[87051]: INFO cinder.rpc [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 20:15:41 devstack cinder-volume[87051]: DEBUG oslo_db.sqlalchemy.engines [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87051) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:15:41 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Determined volume DB was empty at startup. Nov 03 20:15:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87051) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 20:15:41 devstack cinder-volume[87051]: WARNING stevedore.named [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 20:15:41 devstack cinder-volume[87051]: WARNING castellan.key_manager [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:15:41 devstack cinder-volume[87051]: WARNING cinder.keymgr.conf_key_mgr [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:15:42 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_db.sqlalchemy.engines [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87051) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:15:42 devstack cinder-volume[87051]: INFO oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Starting 1 workers Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Started child 87342 {{(pid=87051) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Full set of CONF: {{(pid=87051) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] ******************************************************************************** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] Configuration options gathered from: {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] ================================================================================ {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] allow_availability_zone_fallback = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] allow_compression_on_image_upload = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87342]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] allowed_direct_url_schemes = [] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] api_rate_limit = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] auth_strategy = keystone {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_availability_zone = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_host = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_name = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_stats_polling_interval = 60 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backup_api_class = cinder.backup.api.API {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backup_name_template = backup-%s {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backup_use_same_host = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backup_use_temp_snapshot = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] chap_password = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] chap_username = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cinder_internal_tenant_project_id = d991cea872374425b1f3ba401d493953 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cinder_internal_tenant_user_id = 5c274fcd78064a048443e845f09aff2f {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cluster = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] compression_format = gzip {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] compute_api_class = cinder.compute.nova.API {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] config_dir = [] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] config_source = [] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] control_exchange = openstack {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] debug = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] default_availability_zone = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] default_group_type = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] default_volume_type = QuobyteHD {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] disk_geometry = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] driver_client_cert = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] driver_client_cert_key = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] driver_data_namespace = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] driver_ssl_cert_path = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] driver_ssl_cert_verify = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] driver_use_ssl = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] enable_new_services = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] enable_unsupported_driver = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] enabled_backends = ['QuobyteHD'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] enforce_multipath_for_image_xfer = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] filter_function = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance_api_insecure = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance_api_ssl_compression = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance_ca_certificates_file = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance_catalog_info = image:glance:publicURL {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance_certfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87342) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance_keyfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance_num_retries = 3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance_request_timeout = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] goodness_function = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] graceful_shutdown_timeout = 5 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] group_api_class = cinder.group.api.API {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] host = devstack {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_compress_on_upload = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_conversion_address_space_limit = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_conversion_cpu_limit = 60 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_conversion_disable = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_introspection_address_space_limit = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_introspection_cpu_limit = 60 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_upload_use_cinder_backend = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_upload_use_internal_tenant = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_volume_cache_enabled = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_volume_cache_max_count = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] image_volume_cache_max_size_gb = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] init_host_max_objects_retrieval = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] instance_format = [instance: %(uuid)s] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] iscsi_target_flags = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] iscsi_write_cache = on {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] iser_helper = tgtadm {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] iser_ip_address = 192.168.122.50 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] iser_port = 3260 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] log_color = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] log_config_append = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] log_dir = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] log_file = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] log_options = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] log_rotate_interval = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] log_rotate_interval_type = days {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] log_rotation_type = none {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] max_age = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] max_logfile_count = 30 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] max_logfile_size_mb = 200 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] max_over_subscription_ratio = 20.0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] message_reap_interval = 86400 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] message_ttl = 2592000 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] migration_create_volume_timeout_secs = 300 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] monkey_patch = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] monkey_patch_modules = [] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] my_ip = 192.168.122.50 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] no_snapshot_gb_quota = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] num_iser_scan_tries = 3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] num_shell_tries = 3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] num_volume_device_scan_tries = 3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] nvmeof_conn_info_version = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] nvmet_ns_id = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] nvmet_port_id = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] osapi_max_limit = 1000 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87342) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] osapi_volume_ext_list = [] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.quobyte [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] osapi_volume_listen_port = 8776 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.quobyte [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] osapi_volume_use_ssl = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] osapi_volume_workers = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Running cmd (subprocess): mount.quobyte {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] per_volume_size_limit = -1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] periodic_fuzzy_delay = 60 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] periodic_interval = 60 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] public_endpoint = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] publish_errors = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] quota_backup_gigabytes = 1000 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] quota_backups = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] quota_gigabytes = 1000 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] quota_groups = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] quota_snapshots = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] quota_volumes = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] rate_limit_burst = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] rate_limit_except_level = CRITICAL {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] rate_limit_interval = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] reinit_driver_count = 3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] replication_device = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] report_discard_supported = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] report_interval = 120 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] reservation_clean_interval = 86400 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] reservation_expire = 86400 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] reserved_image_namespaces = [] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] reserved_percentage = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] rpc_response_timeout = 120 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] run_external_periodic_tasks = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] scst_target_driver = iscsi {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] scst_target_iqn_name = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_down_time = 720 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] shell_completion = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] snapshot_name_template = snapshot-%s {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] split_loggers = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] state_path = /opt/stack/data/cinder {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] storage_availability_zone = nova {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] storage_protocol = iSCSI {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] syslog_log_facility = LOG_USER {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] target_helper = lioadm {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] target_ip_address = 192.168.122.50 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] target_port = 3260 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] target_protocol = iscsi {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] target_secondary_ip_addresses = [] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] trace_flags = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] transport_url = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] until_refresh = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] use_chap_auth = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] use_default_quota_class = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] use_journal = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] use_json = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] use_multipath_for_image_xfer = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] use_stderr = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] use_syslog = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] verify_glance_signatures = enabled {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_api_class = cinder.volume.api.API {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_backend_name = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_clear = zero {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_clear_ionice = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_clear_size = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_copy_bps_limit = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack quobyte-client[87345]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 20:15:42 devstack quobyte-client[87345]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_dd_blocksize = 1M {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_name_template = volume-%s {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_service_inithost_offload = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volume_usage_audit_period = month {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] zoning_mode = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_concurrency.disable_process_locking = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.auth_section = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.auth_type = password {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.auth_version = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.cache = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.certfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.include_service_catalog = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.insecure = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.interface = public {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.keyfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_password = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcache_username = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.region_name = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.service_type = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.backend = dogpile.cache.null {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.backend_argument = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.backend_expiration_time = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.config_prefix = cache.oslo {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.debug_cache_backend = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.enable_retry_client = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.enable_socket_keepalive = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.enabled = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.expiration_time = 600 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.hashclient_retry_attempts = 2 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.memcache_dead_retry = 300 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.memcache_pool_maxsize = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.memcache_sasl_enabled = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.password = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.proxies = [] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.redis_db = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.redis_server = localhost:6379 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.retry_attempts = 2 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.retry_delay = 0.0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.socket_keepalive_count = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.socket_keepalive_idle = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.socket_keepalive_interval = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.socket_timeout = 1.0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.tls_allowed_ciphers = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.tls_cafile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.tls_certfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.tls_enabled = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.tls_keyfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cache.username = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] coordination.backend_url = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.asyncio_connection = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.asyncio_slave_connection = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.backend = sqlalchemy {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.connection = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.connection_debug = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.connection_parameters = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.connection_recycle_time = 3600 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.connection_trace = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.db_inc_retry_interval = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.db_max_retries = 20 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.db_max_retry_interval = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.db_retry_interval = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.max_overflow = 50 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.max_pool_size = 5 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.max_retries = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.mysql_wsrep_sync_wait = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.pool_timeout = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.retry_interval = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.slave_connection = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.sqlite_synchronous = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.synchronous_reader = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] database.use_db_reconnect = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_tracing.insecure = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler.connection_string = messaging:// {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler.enabled = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler.es_doc_type = notification {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler.es_scroll_size = 10000 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler.es_scroll_time = 2m {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler.filter_error_trace = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler.hmac_keys = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler.sentinel_service_name = mymaster {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler.socket_timeout = 0.1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler.trace_requests = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler.trace_sqlalchemy = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler_jaeger.process_tags = {} {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler_jaeger.service_name_prefix = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] profiler_otlp.service_name_prefix = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_policy.enforce_new_defaults = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_policy.policy_default_rule = default {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_policy.policy_file = policy.yaml {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] privsep_osbrick.group = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] privsep_osbrick.helper_command = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] privsep_osbrick.user = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cinder_sys_admin.group = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cinder_sys_admin.helper_command = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] cinder_sys_admin.user = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.auth_section = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.auth_type = password {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.cafile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.certfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.collect_timing = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.insecure = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.keyfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.send_service_user_token = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.split_loggers = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.timeout = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.tls_ciphers = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] service_user.tls_min_version = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.auth_section = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.auth_type = password {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.certfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.collect_timing = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.insecure = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.keyfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.region_name = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.split_loggers = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.timeout = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.tls_ciphers = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] glance.tls_min_version = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.backend_availability_zone = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.chap_password = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.chap_username = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.disk_geometry = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.driver_client_cert = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.driver_client_cert_key = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.driver_data_namespace = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.driver_use_ssl = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.extra_capabilities = {} {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.filter_function = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.goodness_function = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.iscsi_target_flags = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.iscsi_write_cache = on {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.iser_helper = tgtadm {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.iser_port = 3260 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nas_host = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nas_login = admin {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nas_mount_options = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nas_password = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nas_private_key = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nas_share_path = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.num_shell_tries = 3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.quobyte_volume_url = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.replication_device = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.report_discard_supported = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.reserved_percentage = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.target_helper = tgtadm {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.target_port = 3260 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.target_protocol = iscsi {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.trace_flags = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.unique_fqdn_network = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.use_chap_auth = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.volume_backend_name = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.volume_clear = zero {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.volume_clear_ionice = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.volume_clear_size = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_reports.file_event_handler = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_reports.log_dir = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.backend_availability_zone = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.backend_host = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.chap_password = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.chap_username = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.chiscsi_conf = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.disk_geometry = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.driver_client_cert = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.driver_data_namespace = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.driver_use_ssl = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.extra_capabilities = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.filter_function = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.goodness_function = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.iser_helper = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.iser_ip_address = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.iser_port = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.iser_target_prefix = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nas_host = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nas_login = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nas_mount_options = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nas_password = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nas_private_key = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nas_share_path = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nas_ssh_port = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.num_shell_tries = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.nvmet_port_id = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.replication_device = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.report_discard_supported = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.reserved_percentage = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.scst_target_driver = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.storage_protocol = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.target_helper = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.target_ip_address = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.target_port = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.target_prefix = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.target_protocol = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.trace_flags = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.use_chap_auth = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.volume_clear = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.volume_clear_size = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] QuobyteHD.volumes_dir = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.ssl = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_notifications.driver = [] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_notifications.retry = -1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] key_manager.fixed_key = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.barbican_api_version = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.barbican_endpoint = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.barbican_endpoint_type = public {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.barbican_region_name = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.cafile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.certfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.collect_timing = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.insecure = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.keyfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.number_of_retries = 60 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.retry_delay = 1 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.send_service_user_token = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.split_loggers = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.timeout = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.tls_ciphers = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.tls_min_version = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.verify_ssl = True {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican.verify_ssl_path = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican_service_user.auth_section = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican_service_user.auth_type = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican_service_user.cafile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican_service_user.certfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican_service_user.collect_timing = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican_service_user.insecure = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican_service_user.keyfile = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican_service_user.split_loggers = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican_service_user.timeout = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican_service_user.tls_ciphers = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] barbican_service_user.tls_min_version = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.approle_role_id = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.approle_secret_id = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.auth_method = approle {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.auth_path = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.kv_mountpoint = secret {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.kv_path = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.kv_version = 2 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.namespace = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.root_token_id = **** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.ssl_ca_crt_file = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.timeout = 60.0 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.token_file = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.token_role = None {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.use_ssl = False {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:15:42 devstack cinder-volume[87051]: DEBUG oslo_service.backend._eventlet.service [None req-411584fa-a29d-41d6-8701-19f3a6b86452 None None] ******************************************************************************** {{(pid=87051) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 20:15:42 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.369s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:42 devstack cinder-volume[87342]: INFO cinder.volume.driver [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Driver hasn't implemented _init_vendor_properties() Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG cinder.volume.driver [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6631889343262, 'free_capacity_gb': 1773.6631889343262, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87342) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_db.sqlalchemy.engines [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writer thread running {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG cinder.db.api [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Building query based on filter {{(pid=87342) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87342) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:15:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:42 devstack cinder-volume[87342]: INFO cinder.keymgr.migration [None req-e63e69ef-6d7a-4ce5-95f4-9345620fae21 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 20:15:42 devstack sudo[87352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:15:42 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:43 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.228s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:43 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:15:43 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Driver initialization completed successfully. Nov 03 20:15:43 devstack cinder-volume[87342]: INFO cinder.manager [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Initiating service 3 cleanup Nov 03 20:15:43 devstack cinder-volume[87342]: INFO cinder.manager [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Service 3 cleanup completed. Nov 03 20:15:43 devstack cinder-volume[87342]: DEBUG cinder.service [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Creating RPC server for service cinder-volume {{(pid=87342) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 20:15:43 devstack cinder-volume[87342]: DEBUG cinder.service [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87342) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 20:15:43 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 20:15:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:15:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:15:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:15:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:15:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:15:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:43 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:15:43 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:43 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:43 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4fcef6cf-5b93-480f-8726-d4433db8379d None None] Driver post RPC initialization completed successfully. Nov 03 20:15:52 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:15:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=3 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:15:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:16:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:16:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 6 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:16:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Flow 'volume_create_manager' (5d0e9100-eaee-4c7e-a91e-a669d42f6849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd7e796-988c-4f60-9558-6daa32c572d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd7e796-988c-4f60-9558-6daa32c572d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-330809934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6864666b-89b0-4d99-a8b6-3a11cb635bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ada1d7f23e4781b0e0757ee341de2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:16:57Z,use_quota=True,user_id='7f7a14a6b5174cfca763049a69e10332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bad3d7-85ef-4c6d-a217-734c8a576c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bad3d7-85ef-4c6d-a217-734c8a576c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8c8bc7-06e7-4cde-a8ae-c82fab6cbbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8c8bc7-06e7-4cde-a8ae-c82fab6cbbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6864666b-89b0-4d99-a8b6-3a11cb635bfe', 'volume_name': 'volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25a0564-fbc1-48ac-8150-db9902b35504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25a0564-fbc1-48ac-8150-db9902b35504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8941a4e9-c775-4312-b7ab-42e477a52c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:16:57 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Volume 6864666b-89b0-4d99-a8b6-3a11cb635bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe', 'volume_size': 1} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-330809934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6864666b-89b0-4d99-a8b6-3a11cb635bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ada1d7f23e4781b0e0757ee341de2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:16:57Z,use_quota=True,user_id='7f7a14a6b5174cfca763049a69e10332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Creating volume 6864666b-89b0-4d99-a8b6-3a11cb635bfe {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:16:57 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:16:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:57 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe 1073741824 Nov 03 20:16:57 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:16:59 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Nov 03 20:16:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe 1073741824" returned: 0 in 1.553s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:16:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:59 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe Nov 03 20:16:59 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:00 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe" returned: 0 in 0.931s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] <== create_volume: return (2704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:17:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.710s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8941a4e9-c775-4312-b7ab-42e477a52c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d592d07-8f29-49ac-a5ac-fb1874953f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:00 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Volume volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe (6864666b-89b0-4d99-a8b6-3a11cb635bfe): created successfully Nov 03 20:17:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d592d07-8f29-49ac-a5ac-fb1874953f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Flow 'volume_create_manager' (5d0e9100-eaee-4c7e-a91e-a669d42f6849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:17:00 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-62c5fc71-15a2-4f12-98c4-21acc058e0cd tempest-DeleteServersTestJSON-846442492 None] Created volume successfully. Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Flow 'volume_create_manager' (3c6f04a1-96c9-4921-b2c0-93be76885769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa92f82a-8f74-4740-8c61-45cb86ac9dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa92f82a-8f74-4740-8c61-45cb86ac9dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-71131778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4198ac8-bb5f-4589-be5c-5f43024a503f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f034ae99db348a5b321a4f51cafe926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:17:04Z,use_quota=True,user_id='019532a878bf4a5681005857a45f0a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104edf83-d60d-45c1-a5cd-d4e1c60474ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104edf83-d60d-45c1-a5cd-d4e1c60474ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217742f3-0670-4bdd-9de8-7b6814de307b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217742f3-0670-4bdd-9de8-7b6814de307b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4198ac8-bb5f-4589-be5c-5f43024a503f', 'volume_name': 'volume-c4198ac8-bb5f-4589-be5c-5f43024a503f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643b4e20-8c43-466d-a503-8751ee330b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643b4e20-8c43-466d-a503-8751ee330b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd67bf7a-5f25-4b7a-897e-c4f4f95c8739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:04 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Volume c4198ac8-bb5f-4589-be5c-5f43024a503f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4198ac8-bb5f-4589-be5c-5f43024a503f', 'volume_size': 1} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-71131778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4198ac8-bb5f-4589-be5c-5f43024a503f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f034ae99db348a5b321a4f51cafe926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:17:04Z,use_quota=True,user_id='019532a878bf4a5681005857a45f0a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Creating volume c4198ac8-bb5f-4589-be5c-5f43024a503f {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:17:04 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:17:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:04 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f 1073741824 Nov 03 20:17:04 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:05 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f 1073741824" returned: 0 in 0.847s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:05 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f Nov 03 20:17:05 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:05 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f" returned: 0 in 0.558s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:17:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd67bf7a-5f25-4b7a-897e-c4f4f95c8739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4198ac8-bb5f-4589-be5c-5f43024a503f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e61af0-b522-4f02-82e8-e7e485470e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:06 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Volume volume-c4198ac8-bb5f-4589-be5c-5f43024a503f (c4198ac8-bb5f-4589-be5c-5f43024a503f): created successfully Nov 03 20:17:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e61af0-b522-4f02-82e8-e7e485470e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Flow 'volume_create_manager' (3c6f04a1-96c9-4921-b2c0-93be76885769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:17:06 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-fce02d4c-4d73-49c3-a42c-f7c370ff82b3 tempest-VolumesAdminNegativeTest-964069549 None] Created volume successfully. Nov 03 20:17:07 devstack cinder-volume[87342]: WARNING py.warnings [req-3df8c322-496c-41d4-90a2-95c47d28813c req-ab939eaf-12f1-441f-aeca-49caead18dc3 tempest-DeleteServersTestJSON-846442492 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 03 20:17:07 devstack cinder-volume[87342]: .first() Nov 03 20:17:07 devstack cinder-volume[87342]: Nov 03 20:17:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-3df8c322-496c-41d4-90a2-95c47d28813c req-ab939eaf-12f1-441f-aeca-49caead18dc3 tempest-DeleteServersTestJSON-846442492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-3df8c322-496c-41d4-90a2-95c47d28813c req-ab939eaf-12f1-441f-aeca-49caead18dc3 tempest-DeleteServersTestJSON-846442492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-3df8c322-496c-41d4-90a2-95c47d28813c req-ab939eaf-12f1-441f-aeca-49caead18dc3 tempest-DeleteServersTestJSON-846442492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-3df8c322-496c-41d4-90a2-95c47d28813c req-ab939eaf-12f1-441f-aeca-49caead18dc3 tempest-DeleteServersTestJSON-846442492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '880c38f9-252a-401f-b817-a6bcd5d518a7', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:17:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Acquiring lock "cinder-c4198ac8-bb5f-4589-be5c-5f43024a503f-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:17:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Lock "cinder-c4198ac8-bb5f-4589-be5c-5f43024a503f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:17:07 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-3df8c322-496c-41d4-90a2-95c47d28813c req-ab939eaf-12f1-441f-aeca-49caead18dc3 tempest-DeleteServersTestJSON-846442492 None] attachment_update completed successfully. Nov 03 20:17:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Acquiring lock "cinder-quobyte-c4198ac8-bb5f-4589-be5c-5f43024a503f" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:17:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Lock "cinder-quobyte-c4198ac8-bb5f-4589-be5c-5f43024a503f" acquired by "delete_volume" :: waited 0.039s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:17:07 devstack cinder-volume[87342]: INFO oslo.privsep.daemon [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpm_dx0o8y/privsep.sock'] Nov 03 20:17:07 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpm_dx0o8y/privsep.sock Nov 03 20:17:07 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:09 devstack cinder-volume[87342]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 20:17:09 devstack cinder-volume[87342]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 20:17:09 devstack cinder-volume[87342]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 20:17:09 devstack cinder-volume[87342]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 20:17:09 devstack cinder-volume[87342]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 20:17:09 devstack cinder-volume[87342]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 20:17:09 devstack cinder-volume[87342]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 20:17:09 devstack cinder-volume[87342]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 20:17:09 devstack cinder-volume[87342]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 20:17:09 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:09 devstack cinder-volume[87342]: INFO oslo.privsep.daemon [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Spawned new privsep daemon via rootwrap Nov 03 20:17:09 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Accepted privsep connection to /tmp/tmpm_dx0o8y/privsep.sock {{(pid=87342) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 20:17:09 devstack cinder-volume[87342]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 20:17:09 devstack cinder-volume[87342]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 20:17:09 devstack cinder-volume[87342]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 20:17:09 devstack cinder-volume[87342]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88948 Nov 03 20:17:09 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e406fc1-ecd0-4fe0-9a5b-a5209745b8d0]: (2,) {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:17:09 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d615ba-d527-4552-8736-12b9ddf4a412]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:17:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:10 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f Nov 03 20:17:10 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:10 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f" returned: 0 in 0.605s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:10 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f Nov 03 20:17:10 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:10 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c4198ac8-bb5f-4589-be5c-5f43024a503f" returned: 0 in 0.333s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Lock "cinder-quobyte-c4198ac8-bb5f-4589-be5c-5f43024a503f" released by "delete_volume" :: held 3.070s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:17:10 devstack cinder-volume[87342]: WARNING cinder.quota [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:17:10 devstack cinder-volume[87342]: WARNING cinder.quota [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:17:10 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Created reservations ['6a4eabfe-2a12-43ad-8999-316c8f5ce652', 'db5208a1-3ea1-45ab-a2d5-3fd5d0f80248', 'cf140ae7-ad90-424a-bbbe-87885e48348a', 'd10a20a9-f168-4ae0-aa94-1e98145a662e'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:17:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:17:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:17:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:11 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:17:11 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:11 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.389s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:11 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:17:11 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Deleted volume successfully. Nov 03 20:17:11 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4d69fe5-0e26-4e7f-9335-a6a319f78f7e tempest-VolumesAdminNegativeTest-964069549 None] Lock "cinder-c4198ac8-bb5f-4589-be5c-5f43024a503f-delete_volume" released by "delete_volume" :: held 4.024s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:17:14 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-9ec1fdbe-989a-4920-a575-f946194c3e94 req-fd86d811-1f78-47d5-bad4-3e09619cda03 tempest-DeleteServersTestJSON-846442492 None] Terminate volume connection completed successfully. Nov 03 20:17:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-9ec1fdbe-989a-4920-a575-f946194c3e94 req-fd86d811-1f78-47d5-bad4-3e09619cda03 tempest-DeleteServersTestJSON-846442492 None] Deleting attachment 880c38f9-252a-401f-b817-a6bcd5d518a7. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:17:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Acquiring lock "cinder-6864666b-89b0-4d99-a8b6-3a11cb635bfe-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:17:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Lock "cinder-6864666b-89b0-4d99-a8b6-3a11cb635bfe-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:17:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Acquiring lock "cinder-quobyte-6864666b-89b0-4d99-a8b6-3a11cb635bfe" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:17:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Lock "cinder-quobyte-6864666b-89b0-4d99-a8b6-3a11cb635bfe" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:17:16 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[528bc8d4-5196-4570-b825-52c6ffc908d1]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:17:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:16 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe Nov 03 20:17:16 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:16 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe" returned: 0 in 0.436s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:16 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe Nov 03 20:17:16 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:16 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6864666b-89b0-4d99-a8b6-3a11cb635bfe" returned: 0 in 0.287s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Lock "cinder-quobyte-6864666b-89b0-4d99-a8b6-3a11cb635bfe" released by "delete_volume" :: held 0.789s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:17:17 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Created reservations ['608411d0-9256-41f6-8585-c4ceb837ab04', 'fbc3ecdf-2fd9-4630-961e-f8cfc40510a7', '13ccd095-855c-4bd7-ac5d-3ffc6c7dd5fe', '5f2ea6dc-a370-48ae-8336-453721ef302e'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:17:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:17:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:17:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:17 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:17:17 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:17 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.336s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:17 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:17:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Deleted volume successfully. Nov 03 20:17:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a1887906-688f-490d-b0c0-4138133d9334 tempest-DeleteServersTestJSON-846442492 None] Lock "cinder-6864666b-89b0-4d99-a8b6-3a11cb635bfe-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Flow 'volume_create_manager' (d98e41d6-4155-4f8e-9c91-9c754a26c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207b7520-e4fe-4ad1-86e7-f9fa3025acec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207b7520-e4fe-4ad1-86e7-f9fa3025acec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-572564771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d0ca99-dcf0-41a7-a935-f5814596e95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241a899848db4305b08efc0b56f5debf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:17:22Z,use_quota=True,user_id='a2cab4195cb148bda9c19093d58d160b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a61a905-575f-4e28-8ee5-bda093408e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a61a905-575f-4e28-8ee5-bda093408e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399ed57d-b82a-465a-bcc1-b40212122f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399ed57d-b82a-465a-bcc1-b40212122f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d0ca99-dcf0-41a7-a935-f5814596e95a', 'volume_name': 'volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6ab653-2d65-4c41-971e-311cabb859d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6ab653-2d65-4c41-971e-311cabb859d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661536de-f939-4176-b33f-cfc0b225423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:22 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Volume e7d0ca99-dcf0-41a7-a935-f5814596e95a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a', 'volume_size': 1} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-572564771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d0ca99-dcf0-41a7-a935-f5814596e95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241a899848db4305b08efc0b56f5debf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:17:22Z,use_quota=True,user_id='a2cab4195cb148bda9c19093d58d160b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Creating volume e7d0ca99-dcf0-41a7-a935-f5814596e95a {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:17:22 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:22 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a 1073741824 Nov 03 20:17:22 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:22 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a 1073741824" returned: 0 in 0.495s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:22 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a Nov 03 20:17:22 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:23 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a" returned: 0 in 0.301s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661536de-f939-4176-b33f-cfc0b225423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9ae23e-f1c4-4d16-bcc1-f5c16a67c2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:23 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Volume volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a (e7d0ca99-dcf0-41a7-a935-f5814596e95a): created successfully Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9ae23e-f1c4-4d16-bcc1-f5c16a67c2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Flow 'volume_create_manager' (d98e41d6-4155-4f8e-9c91-9c754a26c98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:17:23 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2f2d196b-cb66-4eb5-8b16-ba85b848d7d3 tempest-ServerActionsTestOtherA-501095522 None] Created volume successfully. Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:23 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:17:23 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:23 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.253s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 8 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:17:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:17:33 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=22,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:17:33 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=25,cinder:UPDATE=27,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:17:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:17:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Flow 'volume_create_manager' (9dd59a03-8af1-4571-962b-7eb185d0e5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0f700b-d35f-434c-bed2-f92929cf0d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0f700b-d35f-434c-bed2-f92929cf0d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1027762670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38df42a-f74f-4c3f-bb59-176a21b2caae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267cbbbeedb34c90955a548b8671c20a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:17:58Z,use_quota=True,user_id='dd66c39532394be79f4fff54352a8f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46870651-fca3-4b0c-b8a2-0ea71a6119fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46870651-fca3-4b0c-b8a2-0ea71a6119fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce988269-0e82-4d4c-95cd-f76af12aeced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce988269-0e82-4d4c-95cd-f76af12aeced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38df42a-f74f-4c3f-bb59-176a21b2caae', 'volume_name': 'volume-e38df42a-f74f-4c3f-bb59-176a21b2caae', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186bb3a8-e9fd-4703-86bc-3842e95aa1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186bb3a8-e9fd-4703-86bc-3842e95aa1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce34c18d-96e3-4fd6-888f-33508420d0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:57 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Volume e38df42a-f74f-4c3f-bb59-176a21b2caae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38df42a-f74f-4c3f-bb59-176a21b2caae', 'volume_size': 1} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1027762670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38df42a-f74f-4c3f-bb59-176a21b2caae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267cbbbeedb34c90955a548b8671c20a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:17:58Z,use_quota=True,user_id='dd66c39532394be79f4fff54352a8f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Creating volume e38df42a-f74f-4c3f-bb59-176a21b2caae {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:17:57 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:17:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:57 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae 1073741824 Nov 03 20:17:57 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:59 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae 1073741824" returned: 0 in 1.176s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:59 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae Nov 03 20:17:59 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:59 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae" returned: 0 in 0.402s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:17:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce34c18d-96e3-4fd6-888f-33508420d0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38df42a-f74f-4c3f-bb59-176a21b2caae', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0494062-ab1f-4a29-a29c-658ff018add9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:59 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Volume volume-e38df42a-f74f-4c3f-bb59-176a21b2caae (e38df42a-f74f-4c3f-bb59-176a21b2caae): created successfully Nov 03 20:17:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0494062-ab1f-4a29-a29c-658ff018add9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Flow 'volume_create_manager' (9dd59a03-8af1-4571-962b-7eb185d0e5ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:17:59 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b851a462-2419-435d-bf55-a877eb4e87f4 tempest-TaggedAttachmentsTest-600121729 None] Created volume successfully. Nov 03 20:18:09 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:18:09 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:18:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-15594ab7-7999-4d0c-a7bf-a8358b30a564 req-b62ef3cb-542a-4914-8614-a8d9ecda723b tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-15594ab7-7999-4d0c-a7bf-a8358b30a564 req-b62ef3cb-542a-4914-8614-a8d9ecda723b tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-15594ab7-7999-4d0c-a7bf-a8358b30a564 req-b62ef3cb-542a-4914-8614-a8d9ecda723b tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-15594ab7-7999-4d0c-a7bf-a8358b30a564 req-b62ef3cb-542a-4914-8614-a8d9ecda723b tempest-ServerActionsTestOtherA-501095522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '143ecd97-8466-4574-94ea-a4050504825e', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:18:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:18:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:23 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:18:23 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:23 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-15594ab7-7999-4d0c-a7bf-a8358b30a564 req-b62ef3cb-542a-4914-8614-a8d9ecda723b tempest-ServerActionsTestOtherA-501095522 None] attachment_update completed successfully. Nov 03 20:18:24 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Flow 'volume_create_manager' (1b7093cf-6f1b-4085-85d4-14175c614490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b5dc46-b63c-48c2-8bdb-71c377ff6a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.688s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 8 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b5dc46-b63c-48c2-8bdb-71c377ff6a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1461473380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861fab4d-b3bd-43f4-b63e-631c2942c4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6c7918ac334e40a2eae3f469341788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:24Z,use_quota=True,user_id='1a4c9855efb04997a53c94c4566152d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcdd336-e5d5-4cc1-9d75-7404d7d45a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcdd336-e5d5-4cc1-9d75-7404d7d45a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1172311d-1062-4263-bcbf-d54de9e4536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1172311d-1062-4263-bcbf-d54de9e4536d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861fab4d-b3bd-43f4-b63e-631c2942c4f5', 'volume_name': 'volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4b6745-4037-4bbd-9ad0-bdbfae9c13a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4b6745-4037-4bbd-9ad0-bdbfae9c13a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25eb666d-9d93-4fd5-8999-529197f5ce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:24 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Volume 861fab4d-b3bd-43f4-b63e-631c2942c4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5', 'volume_size': 1} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1461473380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861fab4d-b3bd-43f4-b63e-631c2942c4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6c7918ac334e40a2eae3f469341788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:24Z,use_quota=True,user_id='1a4c9855efb04997a53c94c4566152d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Creating volume 861fab4d-b3bd-43f4-b63e-631c2942c4f5 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:18:24 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:18:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:24 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5 1073741824 Nov 03 20:18:24 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:25 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5 1073741824" returned: 0 in 0.753s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:25 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5 Nov 03 20:18:25 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:25 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5" returned: 0 in 0.580s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:18:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25eb666d-9d93-4fd5-8999-529197f5ce30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e97bd13-1e39-47bd-85ef-8606d7375d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:25 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Volume volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5 (861fab4d-b3bd-43f4-b63e-631c2942c4f5): created successfully Nov 03 20:18:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e97bd13-1e39-47bd-85ef-8606d7375d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Flow 'volume_create_manager' (1b7093cf-6f1b-4085-85d4-14175c614490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:18:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8b87da95-d1e0-4a93-aa18-a03e09bf4cf8 tempest-AttachVolumeTestJSON-1745915254 None] Created volume successfully. Nov 03 20:18:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-b24dfa45-a255-4d89-aab6-086761318c22 req-6b31e2dc-3056-4bdb-85b7-2978fbaf31f5 tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-b24dfa45-a255-4d89-aab6-086761318c22 req-6b31e2dc-3056-4bdb-85b7-2978fbaf31f5 tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-b24dfa45-a255-4d89-aab6-086761318c22 req-6b31e2dc-3056-4bdb-85b7-2978fbaf31f5 tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-b24dfa45-a255-4d89-aab6-086761318c22 req-6b31e2dc-3056-4bdb-85b7-2978fbaf31f5 tempest-AttachVolumeTestJSON-1745915254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3353ab7d-2f24-44c3-96b3-bf2388adb88a', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:18:28 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-b24dfa45-a255-4d89-aab6-086761318c22 req-6b31e2dc-3056-4bdb-85b7-2978fbaf31f5 tempest-AttachVolumeTestJSON-1745915254 None] attachment_update completed successfully. Nov 03 20:18:31 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-066350f7-d7a0-4d6e-bf81-8784168c69a2 req-33342d63-dace-46f4-aa6e-6b8edc6394a2 tempest-ServerActionsTestOtherA-501095522 None] Terminate volume connection completed successfully. Nov 03 20:18:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-066350f7-d7a0-4d6e-bf81-8784168c69a2 req-33342d63-dace-46f4-aa6e-6b8edc6394a2 tempest-ServerActionsTestOtherA-501095522 None] Deleting attachment 143ecd97-8466-4574-94ea-a4050504825e. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:18:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-066350f7-d7a0-4d6e-bf81-8784168c69a2 req-9ef6529d-a66f-4a2a-9885-4489d8614522 tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-066350f7-d7a0-4d6e-bf81-8784168c69a2 req-9ef6529d-a66f-4a2a-9885-4489d8614522 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-066350f7-d7a0-4d6e-bf81-8784168c69a2 req-9ef6529d-a66f-4a2a-9885-4489d8614522 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-066350f7-d7a0-4d6e-bf81-8784168c69a2 req-9ef6529d-a66f-4a2a-9885-4489d8614522 tempest-ServerActionsTestOtherA-501095522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3050a5a-c25c-4f29-b799-e362ac74685f', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:18:34 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-066350f7-d7a0-4d6e-bf81-8784168c69a2 req-9ef6529d-a66f-4a2a-9885-4489d8614522 tempest-ServerActionsTestOtherA-501095522 None] attachment_update completed successfully. Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Flow 'volume_create_manager' (6873073b-3e90-4a5b-9fb1-116e4757fc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735dcce7-502a-44f5-b4b3-34d87757cf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735dcce7-502a-44f5-b4b3-34d87757cf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1068389771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251349c8-0445-4b16-9b42-f3e3df65d13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c43923701f451db4e50e5d3131f1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:41Z,use_quota=True,user_id='b55f1e52a6a148a4ae29a2c290f47652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0a1504-fe47-45c5-aaca-28f69ef85739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0a1504-fe47-45c5-aaca-28f69ef85739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb0ed13-b007-4233-b1de-de2fd5e65a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb0ed13-b007-4233-b1de-de2fd5e65a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251349c8-0445-4b16-9b42-f3e3df65d13b', 'volume_name': 'volume-251349c8-0445-4b16-9b42-f3e3df65d13b', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7c91bb-9cbc-460f-832e-58292d8523f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7c91bb-9cbc-460f-832e-58292d8523f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa103249-bb6f-4cb8-93b3-7980de16e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:41 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Volume 251349c8-0445-4b16-9b42-f3e3df65d13b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251349c8-0445-4b16-9b42-f3e3df65d13b', 'volume_size': 1} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1068389771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251349c8-0445-4b16-9b42-f3e3df65d13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c43923701f451db4e50e5d3131f1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:41Z,use_quota=True,user_id='b55f1e52a6a148a4ae29a2c290f47652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Creating volume 251349c8-0445-4b16-9b42-f3e3df65d13b {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:18:41 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:41 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b 1073741824 Nov 03 20:18:41 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:41 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b 1073741824" returned: 0 in 0.428s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:41 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b Nov 03 20:18:41 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:42 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b" returned: 0 in 0.246s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:18:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa103249-bb6f-4cb8-93b3-7980de16e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251349c8-0445-4b16-9b42-f3e3df65d13b', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33856777-3974-4d7e-a542-3b0bc41a9bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:42 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Volume volume-251349c8-0445-4b16-9b42-f3e3df65d13b (251349c8-0445-4b16-9b42-f3e3df65d13b): created successfully Nov 03 20:18:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33856777-3974-4d7e-a542-3b0bc41a9bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Flow 'volume_create_manager' (6873073b-3e90-4a5b-9fb1-116e4757fc17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:18:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b7d6fdf2-6b50-4ef8-b9d2-52f1961d77c0 tempest-ServersNegativeTestJSON-837527121 None] Created volume successfully. Nov 03 20:18:43 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:18:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Flow 'volume_create_manager' (151622ee-c3ea-4ff1-8bac-9193bba4fb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:18:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20d3e09-56b8-42de-90f6-0dc58fa92f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20d3e09-56b8-42de-90f6-0dc58fa92f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-179829247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3315e5ef-b192-4f88-a67f-3306d23505fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c43923701f451db4e50e5d3131f1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:44Z,use_quota=True,user_id='b55f1e52a6a148a4ae29a2c290f47652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a762b5fd-86c2-434c-960c-7d06bbc44312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a762b5fd-86c2-434c-960c-7d06bbc44312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30957c0-f97f-45bb-83d8-e3d26540056f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30957c0-f97f-45bb-83d8-e3d26540056f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3315e5ef-b192-4f88-a67f-3306d23505fd', 'volume_name': 'volume-3315e5ef-b192-4f88-a67f-3306d23505fd', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615ca261-2df5-4d30-ae88-8f30b364c20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615ca261-2df5-4d30-ae88-8f30b364c20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84651e17-4a72-44be-999b-cddf607a8417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:44 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Volume 3315e5ef-b192-4f88-a67f-3306d23505fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3315e5ef-b192-4f88-a67f-3306d23505fd', 'volume_size': 1} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-179829247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3315e5ef-b192-4f88-a67f-3306d23505fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c43923701f451db4e50e5d3131f1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:44Z,use_quota=True,user_id='b55f1e52a6a148a4ae29a2c290f47652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Creating volume 3315e5ef-b192-4f88-a67f-3306d23505fd {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:18:44 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:44 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd 1073741824 Nov 03 20:18:44 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:44 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd 1073741824" returned: 0 in 0.499s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:44 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd Nov 03 20:18:44 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:44 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd" returned: 0 in 0.262s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84651e17-4a72-44be-999b-cddf607a8417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3315e5ef-b192-4f88-a67f-3306d23505fd', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045bf1c0-22ab-4a7d-ae45-04ac1264525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:44 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Volume volume-3315e5ef-b192-4f88-a67f-3306d23505fd (3315e5ef-b192-4f88-a67f-3306d23505fd): created successfully Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045bf1c0-22ab-4a7d-ae45-04ac1264525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Flow 'volume_create_manager' (151622ee-c3ea-4ff1-8bac-9193bba4fb93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:18:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d5afb221-7250-48c4-8a9a-f867562c3279 tempest-ServersNegativeTestJSON-837527121 None] Created volume successfully. Nov 03 20:18:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Acquiring lock "cinder-3315e5ef-b192-4f88-a67f-3306d23505fd-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:18:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Lock "cinder-3315e5ef-b192-4f88-a67f-3306d23505fd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:18:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Acquiring lock "cinder-quobyte-3315e5ef-b192-4f88-a67f-3306d23505fd" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:18:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Lock "cinder-quobyte-3315e5ef-b192-4f88-a67f-3306d23505fd" acquired by "delete_volume" :: waited 0.029s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:18:46 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[221e0498-7d00-4313-94f7-43258ff87001]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:18:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:46 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd Nov 03 20:18:46 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:46 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd" returned: 0 in 0.402s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:46 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd Nov 03 20:18:46 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:47 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3315e5ef-b192-4f88-a67f-3306d23505fd" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Lock "cinder-quobyte-3315e5ef-b192-4f88-a67f-3306d23505fd" released by "delete_volume" :: held 0.717s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Created reservations ['b3bbba48-7297-4cba-8ff4-216cb1ca8aa1', '60bcab5f-726b-4019-b213-e627c0fcbf6a', '6daa9c02-055b-46d8-8c39-932990e5cc95', '4a95f9e7-5f56-4c88-ad21-5f8451da818c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:47 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:18:47 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:47 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.266s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:18:47 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Deleted volume successfully. Nov 03 20:18:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-87812374-4878-4af5-aaac-3e76f174fc8e tempest-ServersNegativeTestJSON-837527121 None] Lock "cinder-3315e5ef-b192-4f88-a67f-3306d23505fd-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:18:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Acquiring lock "cinder-251349c8-0445-4b16-9b42-f3e3df65d13b-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:18:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Lock "cinder-251349c8-0445-4b16-9b42-f3e3df65d13b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:18:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Acquiring lock "cinder-quobyte-251349c8-0445-4b16-9b42-f3e3df65d13b" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:18:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Lock "cinder-quobyte-251349c8-0445-4b16-9b42-f3e3df65d13b" acquired by "delete_volume" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:18:48 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed252d38-c5a8-43f1-a5a4-12db453c1b3f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:18:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:48 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b Nov 03 20:18:48 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:48 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b" returned: 0 in 0.598s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:48 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b Nov 03 20:18:48 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:49 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-251349c8-0445-4b16-9b42-f3e3df65d13b" returned: 0 in 0.267s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Lock "cinder-quobyte-251349c8-0445-4b16-9b42-f3e3df65d13b" released by "delete_volume" :: held 0.956s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Created reservations ['3e2190ba-1bd9-453d-9594-0e9960d7ce0e', '7f99365c-3a24-4fab-a967-1c79f9315144', '02e06449-88e7-4ec4-b562-9c1a8df624ef', '2b695849-729e-4397-ab54-4765d182c5da'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:49 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:18:49 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:49 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.281s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:18:49 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Deleted volume successfully. Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b3b2a89e-568d-418e-9d62-ddffc0a93737 tempest-ServersNegativeTestJSON-837527121 None] Lock "cinder-251349c8-0445-4b16-9b42-f3e3df65d13b-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-5efafa59-220e-4575-872d-ba51e7db63a0 req-4bd493ea-9171-4b60-adaa-7f9812b7621d tempest-TaggedAttachmentsTest-600121729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-5efafa59-220e-4575-872d-ba51e7db63a0 req-4bd493ea-9171-4b60-adaa-7f9812b7621d tempest-TaggedAttachmentsTest-600121729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-5efafa59-220e-4575-872d-ba51e7db63a0 req-4bd493ea-9171-4b60-adaa-7f9812b7621d tempest-TaggedAttachmentsTest-600121729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-5efafa59-220e-4575-872d-ba51e7db63a0 req-4bd493ea-9171-4b60-adaa-7f9812b7621d tempest-TaggedAttachmentsTest-600121729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-e38df42a-f74f-4c3f-bb59-176a21b2caae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d78586b-d801-4332-a746-d76d96c434b9', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:18:49 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-5efafa59-220e-4575-872d-ba51e7db63a0 req-4bd493ea-9171-4b60-adaa-7f9812b7621d tempest-TaggedAttachmentsTest-600121729 None] attachment_update completed successfully. Nov 03 20:18:52 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-d02a89ee-ad3b-4e53-ad4e-592c8b9f34e9 req-ee896164-2843-4068-81a9-889544fb3190 tempest-TaggedAttachmentsTest-600121729 None] Terminate volume connection completed successfully. Nov 03 20:18:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-d02a89ee-ad3b-4e53-ad4e-592c8b9f34e9 req-ee896164-2843-4068-81a9-889544fb3190 tempest-TaggedAttachmentsTest-600121729 None] Deleting attachment 0d78586b-d801-4332-a746-d76d96c434b9. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:18:59 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=43,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:19:02 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=45,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:19:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Acquiring lock "cinder-e38df42a-f74f-4c3f-bb59-176a21b2caae-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:19:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Lock "cinder-e38df42a-f74f-4c3f-bb59-176a21b2caae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:19:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Acquiring lock "cinder-quobyte-e38df42a-f74f-4c3f-bb59-176a21b2caae" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:19:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Lock "cinder-quobyte-e38df42a-f74f-4c3f-bb59-176a21b2caae" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:19:03 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15fce2f-d171-4894-a5ce-9ef6799fd5d9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:19:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:03 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae Nov 03 20:19:03 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:03 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae" returned: 0 in 0.365s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:04 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae Nov 03 20:19:04 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:04 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e38df42a-f74f-4c3f-bb59-176a21b2caae" returned: 0 in 0.279s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Lock "cinder-quobyte-e38df42a-f74f-4c3f-bb59-176a21b2caae" released by "delete_volume" :: held 0.693s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Created reservations ['2e31d670-b266-481a-b1cf-7d2b3a8826cd', '9a4cafa1-b191-4f98-b25f-3f9295733992', 'c58cd9f0-d838-4d0f-b945-d61022f11a0e', '07166fdd-e46a-4f40-a85f-2871317bd20c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:04 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:19:04 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:04 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.282s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:19:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Deleted volume successfully. Nov 03 20:19:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9461e823-cd82-41db-ac11-d075944cf017 tempest-TaggedAttachmentsTest-600121729 None] Lock "cinder-e38df42a-f74f-4c3f-bb59-176a21b2caae-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:19:14 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:19:14 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:19:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:19:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:23 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:19:23 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:24 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.426s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Flow 'volume_create_manager' (445736bf-d72a-47b8-bf12-816f5a4cc5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5e1da6-bb0c-4465-acfe-384cae65a455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5e1da6-bb0c-4465-acfe-384cae65a455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1658235138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574e2367-81d5-4244-9c44-4ef0a62742cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daadd491a3574e61b4ff2c64dc47d90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:42Z,use_quota=True,user_id='44f44d6b179949d2a8c7867f6b383e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b19bc0-8ee0-4f69-bc78-736962d3c027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b19bc0-8ee0-4f69-bc78-736962d3c027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d6a4ab-645f-4277-8995-09ddd8de6fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d6a4ab-645f-4277-8995-09ddd8de6fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574e2367-81d5-4244-9c44-4ef0a62742cf', 'volume_name': 'volume-574e2367-81d5-4244-9c44-4ef0a62742cf', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7385377f-eec3-487c-8f25-705ca5657c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7385377f-eec3-487c-8f25-705ca5657c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a9326d-5b4d-402a-8e97-da27a18e53c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:42 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Volume 574e2367-81d5-4244-9c44-4ef0a62742cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574e2367-81d5-4244-9c44-4ef0a62742cf', 'volume_size': 1} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1658235138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574e2367-81d5-4244-9c44-4ef0a62742cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daadd491a3574e61b4ff2c64dc47d90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:42Z,use_quota=True,user_id='44f44d6b179949d2a8c7867f6b383e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Creating volume 574e2367-81d5-4244-9c44-4ef0a62742cf {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:19:42 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:19:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:42 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf 1073741824 Nov 03 20:19:42 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:43 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf 1073741824" returned: 0 in 0.570s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:43 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf Nov 03 20:19:43 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:43 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf" returned: 0 in 0.614s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:19:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a9326d-5b4d-402a-8e97-da27a18e53c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574e2367-81d5-4244-9c44-4ef0a62742cf', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e43cfdd-b06a-4433-99af-0c4b03aac9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:43 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Volume volume-574e2367-81d5-4244-9c44-4ef0a62742cf (574e2367-81d5-4244-9c44-4ef0a62742cf): created successfully Nov 03 20:19:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e43cfdd-b06a-4433-99af-0c4b03aac9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Flow 'volume_create_manager' (445736bf-d72a-47b8-bf12-816f5a4cc5a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:43 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-dcc2aa3d-7c55-42a5-82c0-84ab837f03a5 tempest-AttachVolumeShelveTestJSON-420992755 None] Created volume successfully. Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Flow 'volume_create_manager' (a5f7ae7e-1a81-4e2e-9c05-c50042e3d81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72813aa0-f4d2-4111-bd4d-1f52f41184de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72813aa0-f4d2-4111-bd4d-1f52f41184de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2134431792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35acf407-eff0-4ed7-9f5a-dd86d0dccc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03437489744d4602afd10629f50fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:50Z,use_quota=True,user_id='f774a4984919467698fa8a86dd00178b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b273c8-6cf8-4580-8176-a6888e8c89cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b273c8-6cf8-4580-8176-a6888e8c89cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf220229-3bcf-4568-935b-cefe13420ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf220229-3bcf-4568-935b-cefe13420ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35acf407-eff0-4ed7-9f5a-dd86d0dccc02', 'volume_name': 'volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd4417f-6d1e-4ce8-9f69-ae1cf4463714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd4417f-6d1e-4ce8-9f69-ae1cf4463714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f35a62-4937-432b-bac1-9df1138649d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:49 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Volume 35acf407-eff0-4ed7-9f5a-dd86d0dccc02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02', 'volume_size': 1} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2134431792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35acf407-eff0-4ed7-9f5a-dd86d0dccc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03437489744d4602afd10629f50fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:50Z,use_quota=True,user_id='f774a4984919467698fa8a86dd00178b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Creating volume 35acf407-eff0-4ed7-9f5a-dd86d0dccc02 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:19:49 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:19:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:49 devstack sudo[91820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02 1073741824 Nov 03 20:19:49 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:50 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02 1073741824" returned: 0 in 0.634s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:50 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02 Nov 03 20:19:50 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:51 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02" returned: 0 in 0.715s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:19:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f35a62-4937-432b-bac1-9df1138649d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b79c433-8bea-412e-a137-3e872ab0dc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:51 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Volume volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02 (35acf407-eff0-4ed7-9f5a-dd86d0dccc02): created successfully Nov 03 20:19:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b79c433-8bea-412e-a137-3e872ab0dc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Flow 'volume_create_manager' (a5f7ae7e-1a81-4e2e-9c05-c50042e3d81b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c71e052f-a8bc-40a9-8391-32841c72ebd2 tempest-ServerRescueNegativeTestJSON-1000968980 None] Created volume successfully. Nov 03 20:19:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-67733a3e-2342-472d-a8a1-311af4e14df6 req-551eafff-8644-415c-be41-2bb97aea1946 tempest-AttachVolumeShelveTestJSON-420992755 None] No connector for attachment d923d122-4e54-4b05-b844-f597697dc228; skipping storage backend terminate_connection call. {{(pid=87342) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 20:19:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-67733a3e-2342-472d-a8a1-311af4e14df6 req-551eafff-8644-415c-be41-2bb97aea1946 tempest-AttachVolumeShelveTestJSON-420992755 None] Deleting attachment d923d122-4e54-4b05-b844-f597697dc228. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:20:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Acquiring lock "cinder-35acf407-eff0-4ed7-9f5a-dd86d0dccc02-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Lock "cinder-35acf407-eff0-4ed7-9f5a-dd86d0dccc02-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Acquiring lock "cinder-quobyte-35acf407-eff0-4ed7-9f5a-dd86d0dccc02" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Lock "cinder-quobyte-35acf407-eff0-4ed7-9f5a-dd86d0dccc02" acquired by "delete_volume" :: waited 0.037s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6573fb56-95c5-49c0-9196-5e34d0d65fab]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:02 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02 Nov 03 20:20:02 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:02 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02" returned: 0 in 0.534s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:02 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02 Nov 03 20:20:02 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:03 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-35acf407-eff0-4ed7-9f5a-dd86d0dccc02" returned: 0 in 0.386s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Lock "cinder-quobyte-35acf407-eff0-4ed7-9f5a-dd86d0dccc02" released by "delete_volume" :: held 1.038s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Created reservations ['7a292264-6884-41de-b8d4-1dd5048f6c1b', '9c82de90-2d91-4352-9eb4-e21b783900de', '1096f25b-166e-4191-ab27-1a3cc848fcca', 'bd4308cb-75d3-4f79-b2bb-30b02fd14964'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:03 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:20:03 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:03 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.316s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:03 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Deleted volume successfully. Nov 03 20:20:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-467f6cc3-963f-494f-a7e2-8cd281349461 tempest-ServerRescueNegativeTestJSON-1000968980 None] Lock "cinder-35acf407-eff0-4ed7-9f5a-dd86d0dccc02-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:13 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=20,cinder:SELECT=10,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:20:13 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=9,cinder:DELETE=2 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:23 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:20:23 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:23 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.263s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 8 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:20:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Flow 'volume_create_manager' (ba1fe4e3-f22c-456c-b135-564113f0d7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f413c2-380d-4d66-a325-de4084a3e51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f413c2-380d-4d66-a325-de4084a3e51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-593916024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e0475c-f4f1-41fa-9676-0657e3789f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57ea3bfb2164618b8646f0a219f9c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:32Z,use_quota=True,user_id='eb45799f60a241bf9ec437605baf08d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1361f014-dbb4-461e-be7a-560be0e0f04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1361f014-dbb4-461e-be7a-560be0e0f04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e6cef0-6757-49f6-9657-4a978161226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e6cef0-6757-49f6-9657-4a978161226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8e0475c-f4f1-41fa-9676-0657e3789f99', 'volume_name': 'volume-f8e0475c-f4f1-41fa-9676-0657e3789f99', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f689756e-b304-40f6-9640-e7398f40c90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f689756e-b304-40f6-9640-e7398f40c90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7504f4-b59c-4d2f-b444-42a5889d4ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:31 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Volume f8e0475c-f4f1-41fa-9676-0657e3789f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8e0475c-f4f1-41fa-9676-0657e3789f99', 'volume_size': 1} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-593916024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e0475c-f4f1-41fa-9676-0657e3789f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57ea3bfb2164618b8646f0a219f9c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:32Z,use_quota=True,user_id='eb45799f60a241bf9ec437605baf08d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Creating volume f8e0475c-f4f1-41fa-9676-0657e3789f99 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:20:31 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:20:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:31 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 1073741824 Nov 03 20:20:31 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:32 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 1073741824" returned: 0 in 0.662s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:32 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 Nov 03 20:20:32 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:32 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99" returned: 0 in 0.286s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:20:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7504f4-b59c-4d2f-b444-42a5889d4ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e0475c-f4f1-41fa-9676-0657e3789f99', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46e0a38-3c7e-475e-9b64-589a6ea4dee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:32 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Volume volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 (f8e0475c-f4f1-41fa-9676-0657e3789f99): created successfully Nov 03 20:20:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46e0a38-3c7e-475e-9b64-589a6ea4dee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Flow 'volume_create_manager' (ba1fe4e3-f22c-456c-b135-564113f0d7f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:32 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-dbc1cddc-6470-4c32-9f0a-373e308c8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Created volume successfully. Nov 03 20:20:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Creating offline snapshot 1bc7eacd-1063-43f5-90a3-a71bbc550294 of volume f8e0475c-f4f1-41fa-9676-0657e3789f99 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:20:34 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea765afe-55cd-496c-9d1a-a75d2b9162d3]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:34 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 Nov 03 20:20:34 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:34 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99" returned: 0 in 0.357s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:34 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 1G Nov 03 20:20:34 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:34 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 1G" returned: 0 in 0.475s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:34 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 Nov 03 20:20:34 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:35 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294" returned: 0 in 0.285s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:35 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 is being set with open permissions: ugo+rw Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:35 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 Nov 03 20:20:35 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Acquiring lock "cinder-574e2367-81d5-4244-9c44-4ef0a62742cf-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Lock "cinder-574e2367-81d5-4244-9c44-4ef0a62742cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:35 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294" returned: 0 in 0.290s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Acquiring lock "cinder-quobyte-574e2367-81d5-4244-9c44-4ef0a62742cf" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Lock "cinder-quobyte-574e2367-81d5-4244-9c44-4ef0a62742cf" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd69c25-16df-44d6-9208-a53651e160be]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:35 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.info Nov 03 20:20:35 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:35 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf Nov 03 20:20:35 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:35 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.info" returned: 0 in 0.267s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:35 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.info is being set with open permissions: ugo+rw Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:35 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.info Nov 03 20:20:35 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:35 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf" returned: 0 in 0.373s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:35 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf Nov 03 20:20:35 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:35 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.info" returned: 0 in 0.267s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:36 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-cbf88fb7-9ff5-44a3-9bea-b039b1e0e790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Create snapshot completed successfully Nov 03 20:20:36 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-574e2367-81d5-4244-9c44-4ef0a62742cf" returned: 0 in 0.259s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Lock "cinder-quobyte-574e2367-81d5-4244-9c44-4ef0a62742cf" released by "delete_volume" :: held 0.686s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Created reservations ['4c42ca81-1a2a-470d-8bf2-3f4d9eb93370', '2f72000e-5983-4c8c-b060-d28e077e6cd6', 'b8ec76a3-3d84-40b9-a033-0023f7637d11', '199bf253-e354-46a7-89ad-7a47a73fa873'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:36 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:20:36 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:36 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:36 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Deleted volume successfully. Nov 03 20:20:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d251d7e8-14af-4995-9a9e-c77a60a2011d tempest-AttachVolumeShelveTestJSON-420992755 None] Lock "cinder-574e2367-81d5-4244-9c44-4ef0a62742cf-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Acquiring lock "cinder-1bc7eacd-1063-43f5-90a3-a71bbc550294-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "cinder-1bc7eacd-1063-43f5-90a3-a71bbc550294-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Acquiring lock "cinder-quobyte-f8e0475c-f4f1-41fa-9676-0657e3789f99" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "cinder-quobyte-f8e0475c-f4f1-41fa-9676-0657e3789f99" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Acquiring lock "cinder-quobyte-1bc7eacd-1063-43f5-90a3-a71bbc550294" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "cinder-quobyte-1bc7eacd-1063-43f5-90a3-a71bbc550294" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Deleting offline snapshot 1bc7eacd-1063-43f5-90a3-a71bbc550294 of volume f8e0475c-f4f1-41fa-9676-0657e3789f99 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:20:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] snapshot_file for this snap is: volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:20:37 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d72f8b-8cd9-449b-b0a8-3fd71a70cec5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:37 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 Nov 03 20:20:37 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:38 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294" returned: 0 in 0.379s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e0475c-f4f1-41fa-9676-0657e3789f99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:20:38 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ae713d-bdf4-49a9-bf8d-2f1e4f5d9819]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:38 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 Nov 03 20:20:38 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:38 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99" returned: 0 in 0.418s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:38 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 Nov 03 20:20:38 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:38 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294" returned: 0 in 0.360s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:38 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294 Nov 03 20:20:38 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:39 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99.1bc7eacd-1063-43f5-90a3-a71bbc550294" returned: 0 in 0.272s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "cinder-quobyte-1bc7eacd-1063-43f5-90a3-a71bbc550294" released by "_delete_snapshot" :: held 1.563s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "cinder-quobyte-f8e0475c-f4f1-41fa-9676-0657e3789f99" released by "delete_snapshot" :: held 1.589s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:39 devstack cinder-volume[87342]: WARNING cinder.quota [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:20:39 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Created reservations ['351ad8af-9379-478b-924b-8275f2a6f7a2', 'fe34e2d8-17dc-43b8-87e4-34bd4fc02acd', '427b18b7-ac8c-46f7-9722-89b8a9ef8534', '65900e22-a6d3-41d8-ab4b-b56510153bf1'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Delete snapshot completed successfully. Nov 03 20:20:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f2f55ee5-3e17-4397-a371-98a0bc740e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "cinder-1bc7eacd-1063-43f5-90a3-a71bbc550294-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Acquiring lock "cinder-f8e0475c-f4f1-41fa-9676-0657e3789f99-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "cinder-f8e0475c-f4f1-41fa-9676-0657e3789f99-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Acquiring lock "cinder-quobyte-f8e0475c-f4f1-41fa-9676-0657e3789f99" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "cinder-quobyte-f8e0475c-f4f1-41fa-9676-0657e3789f99" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e562d4-8d7b-43fd-9213-c1982546503a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:40 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 Nov 03 20:20:40 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:40 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99" returned: 0 in 0.399s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:40 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99 Nov 03 20:20:40 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:40 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f8e0475c-f4f1-41fa-9676-0657e3789f99" returned: 0 in 0.266s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "cinder-quobyte-f8e0475c-f4f1-41fa-9676-0657e3789f99" released by "delete_volume" :: held 0.781s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Created reservations ['943b827b-5efd-4df2-99fc-f82bbcc4c545', '5062c6e6-1cbe-42b6-b3aa-27e550a4fd72', 'e48b685e-abb1-497e-a111-43498e185697', '70925233-4af6-458f-ab06-811cde093544'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:40 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:20:40 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:41 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.303s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:41 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:41 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Deleted volume successfully. Nov 03 20:20:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-53606a3d-9dce-4693-a668-0a69199384e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1507563295 None] Lock "cinder-f8e0475c-f4f1-41fa-9676-0657e3789f99-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:44 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:20:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Flow 'volume_create_manager' (a290ed53-d931-4380-ad83-d275dc29041d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f13820-b460-4ac9-9b1d-e3bfceaa32e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f13820-b460-4ac9-9b1d-e3bfceaa32e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1608133875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e24bf73-9ab9-4002-9920-871d56596959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8c13eab5e54e22bd5ef7f55a7cedbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:45Z,use_quota=True,user_id='39916403518b439fb70f2c244285d6e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6ec711-6585-4f6b-b895-ac277b8a9467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6ec711-6585-4f6b-b895-ac277b8a9467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d930b1-0d0b-44f7-9db6-fc82b4d7ad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d930b1-0d0b-44f7-9db6-fc82b4d7ad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e24bf73-9ab9-4002-9920-871d56596959', 'volume_name': 'volume-5e24bf73-9ab9-4002-9920-871d56596959', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5afc2d-d75e-4e4a-ad79-4077d92d8fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5afc2d-d75e-4e4a-ad79-4077d92d8fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685f0620-fafd-4efd-8096-37c8885e31c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:45 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Volume 5e24bf73-9ab9-4002-9920-871d56596959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e24bf73-9ab9-4002-9920-871d56596959', 'volume_size': 1} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1608133875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e24bf73-9ab9-4002-9920-871d56596959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8c13eab5e54e22bd5ef7f55a7cedbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:45Z,use_quota=True,user_id='39916403518b439fb70f2c244285d6e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Creating volume 5e24bf73-9ab9-4002-9920-871d56596959 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:20:45 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:45 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 1073741824 Nov 03 20:20:45 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:45 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 1073741824" returned: 0 in 0.478s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:45 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 Nov 03 20:20:45 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:45 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685f0620-fafd-4efd-8096-37c8885e31c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e24bf73-9ab9-4002-9920-871d56596959', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac83c0bd-56ff-4ab1-a7f3-090b017ea899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:45 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Volume volume-5e24bf73-9ab9-4002-9920-871d56596959 (5e24bf73-9ab9-4002-9920-871d56596959): created successfully Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac83c0bd-56ff-4ab1-a7f3-090b017ea899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Flow 'volume_create_manager' (a290ed53-d931-4380-ad83-d275dc29041d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-fc5f7081-4af9-47b9-abf4-557e686b31da req-d1f8faa2-d66f-4bb4-95a5-b6001a3ce94d tempest-VolumesSnapshotsTestJSON-84128200 None] Created volume successfully. Nov 03 20:20:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] Creating offline snapshot 33aa1385-9516-4e02-9b03-bfb9aa544f4a of volume 5e24bf73-9ab9-4002-9920-871d56596959 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:20:46 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[34207e60-7e45-41bf-b71c-14c853c2bf41]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:46 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 Nov 03 20:20:46 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:46 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959" returned: 0 in 0.445s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:46 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a 1G Nov 03 20:20:46 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:47 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a 1G" returned: 0 in 0.430s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e24bf73-9ab9-4002-9920-871d56596959 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:47 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e24bf73-9ab9-4002-9920-871d56596959 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a Nov 03 20:20:47 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:47 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e24bf73-9ab9-4002-9920-871d56596959 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a" returned: 0 in 0.332s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:47 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a is being set with open permissions: ugo+rw Nov 03 20:20:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:47 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a Nov 03 20:20:47 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:47 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:47 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.info Nov 03 20:20:47 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:48 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.info" returned: 0 in 0.254s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:48 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.info is being set with open permissions: ugo+rw Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:48 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.info Nov 03 20:20:48 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:48 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.info" returned: 0 in 0.258s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:48 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-3c80c2f4-05f0-40e9-a121-cb3adcfe610d req-3365ff72-9f8e-4b06-bbdf-fbc80eb00309 tempest-VolumesSnapshotsTestJSON-84128200 None] Create snapshot completed successfully Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Acquiring lock "cinder-33aa1385-9516-4e02-9b03-bfb9aa544f4a-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "cinder-33aa1385-9516-4e02-9b03-bfb9aa544f4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Acquiring lock "cinder-quobyte-5e24bf73-9ab9-4002-9920-871d56596959" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "cinder-quobyte-5e24bf73-9ab9-4002-9920-871d56596959" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Acquiring lock "cinder-quobyte-33aa1385-9516-4e02-9b03-bfb9aa544f4a" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "cinder-quobyte-33aa1385-9516-4e02-9b03-bfb9aa544f4a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Deleting offline snapshot 33aa1385-9516-4e02-9b03-bfb9aa544f4a of volume 5e24bf73-9ab9-4002-9920-871d56596959 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] snapshot_file for this snap is: volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0717b751-5fd8-4558-9cff-22eda8cdecbe]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:49 devstack sudo[92316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a Nov 03 20:20:49 devstack sudo[92316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:49 devstack sudo[92316]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a" returned: 0 in 0.381s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e24bf73-9ab9-4002-9920-871d56596959(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:20:49 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc621e2-aa05-429b-b82e-65c604235aa2]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:49 devstack sudo[92321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 Nov 03 20:20:49 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:49 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959" returned: 0 in 0.400s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:49 devstack sudo[92326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a Nov 03 20:20:49 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:50 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a" returned: 0 in 0.391s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:50 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a Nov 03 20:20:50 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:50 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959.33aa1385-9516-4e02-9b03-bfb9aa544f4a" returned: 0 in 0.259s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "cinder-quobyte-33aa1385-9516-4e02-9b03-bfb9aa544f4a" released by "_delete_snapshot" :: held 1.551s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "cinder-quobyte-5e24bf73-9ab9-4002-9920-871d56596959" released by "delete_snapshot" :: held 1.576s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:50 devstack cinder-volume[87342]: DEBUG cinder.quota [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Created reservations ['62708761-c830-44c0-b56f-6ac07445a4de', '0fdece07-8c05-4517-9011-daef78f71b8a', 'bd414f57-fffd-455a-a33f-65c905691859', 'f32ab6d7-ccb1-41d8-9bde-491fc2557532'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:50 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Delete snapshot completed successfully. Nov 03 20:20:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-10ff5b43-348a-44fb-8139-2ef162e80130 req-225a1244-a4d4-4e65-ade7-16e7f38c8b5b tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "cinder-33aa1385-9516-4e02-9b03-bfb9aa544f4a-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Acquiring lock "cinder-5e24bf73-9ab9-4002-9920-871d56596959-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "cinder-5e24bf73-9ab9-4002-9920-871d56596959-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Acquiring lock "cinder-quobyte-5e24bf73-9ab9-4002-9920-871d56596959" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "cinder-quobyte-5e24bf73-9ab9-4002-9920-871d56596959" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:51 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc0bec5-0f65-4b92-9f96-75b6ded7440f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:51 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 Nov 03 20:20:51 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:51 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959" returned: 0 in 0.379s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:51 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959 Nov 03 20:20:51 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:51 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5e24bf73-9ab9-4002-9920-871d56596959" returned: 0 in 0.251s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "cinder-quobyte-5e24bf73-9ab9-4002-9920-871d56596959" released by "delete_volume" :: held 0.719s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:52 devstack cinder-volume[87342]: DEBUG cinder.quota [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Created reservations ['1a38bf6b-21a7-4a88-ab31-399863574336', 'd9d3b7f0-6e5e-4dd3-9d9a-dfff622ed6f2', '89eaa966-e843-42ad-bca4-efc318bd5394', '11e7dbf4-9692-484c-b256-bdd2197964c7'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:52 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:20:52 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:52 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.251s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:52 devstack cinder-volume[87342]: DEBUG cinder.manager [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:52 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Deleted volume successfully. Nov 03 20:20:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-49f13d68-57fa-4b1c-bb0f-36c73b824cfe req-03d4daaa-7d2a-4286-b861-f88dd0657063 tempest-VolumesSnapshotsTestJSON-84128200 None] Lock "cinder-5e24bf73-9ab9-4002-9920-871d56596959-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Flow 'volume_create_manager' (9e075916-4e6b-4aa4-9281-dd0379329c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9ec544-b767-45d8-b393-d653ed4b0176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9ec544-b767-45d8-b393-d653ed4b0176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-205653363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ab67de-6063-4963-a823-e419855810b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7b6734f548b438aa7bade9c7d1543b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:56Z,use_quota=True,user_id='b7814d8d718043a68b9270868c93d968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac918ff-31bf-4b78-81ab-f417e1b726ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac918ff-31bf-4b78-81ab-f417e1b726ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b507ee-f939-4a25-997a-8146501ec67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b507ee-f939-4a25-997a-8146501ec67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ab67de-6063-4963-a823-e419855810b8', 'volume_name': 'volume-22ab67de-6063-4963-a823-e419855810b8', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b656027a-cc2f-44fd-8b4f-ec4cf9112ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b656027a-cc2f-44fd-8b4f-ec4cf9112ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a4b706-aca9-4164-b00a-d5f0f967a93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:56 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Volume 22ab67de-6063-4963-a823-e419855810b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ab67de-6063-4963-a823-e419855810b8', 'volume_size': 1} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-205653363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ab67de-6063-4963-a823-e419855810b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7b6734f548b438aa7bade9c7d1543b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:56Z,use_quota=True,user_id='b7814d8d718043a68b9270868c93d968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Creating volume 22ab67de-6063-4963-a823-e419855810b8 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:20:56 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:20:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:56 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8 1073741824 Nov 03 20:20:56 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:57 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8 1073741824" returned: 0 in 0.440s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:57 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8 Nov 03 20:20:57 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:57 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8" returned: 0 in 0.296s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a4b706-aca9-4164-b00a-d5f0f967a93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ab67de-6063-4963-a823-e419855810b8', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf17636-3003-485e-8cd6-f4cd136ee74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:57 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Volume volume-22ab67de-6063-4963-a823-e419855810b8 (22ab67de-6063-4963-a823-e419855810b8): created successfully Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf17636-3003-485e-8cd6-f4cd136ee74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Flow 'volume_create_manager' (9e075916-4e6b-4aa4-9281-dd0379329c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:57 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-496c9601-6f78-4e89-ba96-ecc84f1fc0b2 req-a6e01448-2498-41ea-853e-34eab4314de4 tempest-VolumesGetTestJSON-760916713 None] Created volume successfully. Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Acquiring lock "cinder-22ab67de-6063-4963-a823-e419855810b8-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Lock "cinder-22ab67de-6063-4963-a823-e419855810b8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Acquiring lock "cinder-quobyte-22ab67de-6063-4963-a823-e419855810b8" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Lock "cinder-quobyte-22ab67de-6063-4963-a823-e419855810b8" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e05547-5ee8-49eb-af2f-ffc71cbcb190]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:58 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8 Nov 03 20:20:58 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:58 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8" returned: 0 in 0.456s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:58 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8 Nov 03 20:20:58 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:58 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-22ab67de-6063-4963-a823-e419855810b8" returned: 0 in 0.279s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Lock "cinder-quobyte-22ab67de-6063-4963-a823-e419855810b8" released by "delete_volume" :: held 0.791s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:58 devstack cinder-volume[87342]: DEBUG cinder.quota [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Created reservations ['9e41362a-6385-4fc5-95ca-3af30d7d7c81', '00e2d34c-57ea-4f31-bd5f-6108e26c9f91', 'a8059255-69be-48be-8d55-807aba7248f4', '9f4aa648-5f64-48bd-b069-18a00a736ee0'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:58 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:20:58 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:59 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.346s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:59 devstack cinder-volume[87342]: DEBUG cinder.manager [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:59 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Deleted volume successfully. Nov 03 20:20:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-5d9db7e3-3e3f-4e7c-b45b-7b8106a4be42 req-cc03a563-df04-4eb7-9aa3-6a888a078980 tempest-VolumesGetTestJSON-760916713 None] Lock "cinder-22ab67de-6063-4963-a823-e419855810b8-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:03 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-1691fa02-6c42-459c-b272-68a853fcc761 tempest-GroupSnapshotsTest-1212772872 None] Group tempest-GroupSnapshotsTest-Group-314368433: creating Nov 03 20:21:03 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-1691fa02-6c42-459c-b272-68a853fcc761 tempest-GroupSnapshotsTest-1212772872 None] Group tempest-GroupSnapshotsTest-Group-314368433: created successfully Nov 03 20:21:03 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-1691fa02-6c42-459c-b272-68a853fcc761 tempest-GroupSnapshotsTest-1212772872 None] Create group completed successfully. Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Flow 'volume_create_manager' (df3e5430-88bd-457f-944b-c4cf018e74a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0c1fb0-a5ea-4eef-a898-5984c67284a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0c1fb0-a5ea-4eef-a898-5984c67284a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2134331512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71e93482-273b-4ed8-a23d-3f0c912d473f,host='devstack@QuobyteHD#QuobyteHD',id=ed99254d-fd09-46d7-99c9-31f56b4cbbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d55d7e75b154ca6b808bd760215e0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:06Z,use_quota=True,user_id='180d426648fd4a84b5e3fb004857bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5b0b0f7-12ff-43ff-8b1c-bc15c139dd40),volume_type_id=c5b0b0f7-12ff-43ff-8b1c-bc15c139dd40)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2ae822-9201-4112-b413-e920ba1f2dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2ae822-9201-4112-b413-e920ba1f2dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb13324-65e6-4dc1-974e-0822bba3193d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb13324-65e6-4dc1-974e-0822bba3193d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed99254d-fd09-46d7-99c9-31f56b4cbbc1', 'volume_name': 'volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f932d1-b41f-4ee1-adb9-9b9801bcfb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f932d1-b41f-4ee1-adb9-9b9801bcfb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b26193a-7ec4-43c9-a96d-4b55d9dc4103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:05 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Volume ed99254d-fd09-46d7-99c9-31f56b4cbbc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1', 'volume_size': 1} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=71e93482-273b-4ed8-a23d-3f0c912d473f,created_at=2026-11-03T19:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2134331512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71e93482-273b-4ed8-a23d-3f0c912d473f,host='devstack@QuobyteHD#QuobyteHD',id=ed99254d-fd09-46d7-99c9-31f56b4cbbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d55d7e75b154ca6b808bd760215e0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:06Z,use_quota=True,user_id='180d426648fd4a84b5e3fb004857bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5b0b0f7-12ff-43ff-8b1c-bc15c139dd40),volume_type_id=c5b0b0f7-12ff-43ff-8b1c-bc15c139dd40)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Creating volume ed99254d-fd09-46d7-99c9-31f56b4cbbc1 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:05 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:21:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:05 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 1073741824 Nov 03 20:21:05 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:06 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 1073741824" returned: 0 in 0.440s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:06 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 Nov 03 20:21:06 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:06 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" returned: 0 in 0.354s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b26193a-7ec4-43c9-a96d-4b55d9dc4103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946407e4-d985-421e-ae6d-8f463d990ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:06 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Volume volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 (ed99254d-fd09-46d7-99c9-31f56b4cbbc1): created successfully Nov 03 20:21:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946407e4-d985-421e-ae6d-8f463d990ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Flow 'volume_create_manager' (df3e5430-88bd-457f-944b-c4cf018e74a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:06 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-579a29dc-e6be-41f9-a446-d282f3d3d3e9 tempest-GroupSnapshotsTest-1212772872 None] Created volume successfully. Nov 03 20:21:07 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] GroupSnapshot 3b0b64c0-775a-470c-a992-7a5a903c6754: creating. Nov 03 20:21:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] Group snapshot 3b0b64c0-775a-470c-a992-7a5a903c6754: creating. {{(pid=87342) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 20:21:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] Creating offline snapshot d69a2623-64b2-4b40-b485-c67b2ab52969 of volume ed99254d-fd09-46d7-99c9-31f56b4cbbc1 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:21:07 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d97515-5263-4a12-92e3-62744e6d032d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:07 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 Nov 03 20:21:07 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:07 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" returned: 0 in 0.381s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:07 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 1G Nov 03 20:21:07 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:08 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 1G" returned: 0 in 0.458s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:08 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 Nov 03 20:21:08 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:08 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969" returned: 0 in 0.401s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:08 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:08 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 Nov 03 20:21:08 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:08 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969" returned: 0 in 0.277s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:08 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.info Nov 03 20:21:08 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:08 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.info" returned: 0 in 0.270s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:09 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:09 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.info Nov 03 20:21:09 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:09 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.info" returned: 0 in 0.293s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:09 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e445b34a-ff17-40bd-b10a-34de49fa5848 tempest-GroupSnapshotsTest-1212772872 None] group_snapshot 3b0b64c0-775a-470c-a992-7a5a903c6754: created successfully Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-d69a2623-64b2-4b40-b485-c67b2ab52969-adef6b73-6cfa-4eaf-9069-8f0af440997d" by "_create_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-d69a2623-64b2-4b40-b485-c67b2ab52969-adef6b73-6cfa-4eaf-9069-8f0af440997d" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Creating volume adef6b73-6cfa-4eaf-9069-8f0af440997d from snapshot d69a2623-64b2-4b40-b485-c67b2ab52969 {{(pid=87342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-adef6b73-6cfa-4eaf-9069-8f0af440997d" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-adef6b73-6cfa-4eaf-9069-8f0af440997d" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] snapshot: d69a2623-64b2-4b40-b485-c67b2ab52969, volume: adef6b73-6cfa-4eaf-9069-8f0af440997d, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[578b36e8-784c-47f0-9e0b-53d22e8089c3]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:11 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 Nov 03 20:21:11 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:11 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969" returned: 0 in 0.439s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ab85d3-a257-47d4-bd00-78690c489a44]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:11 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 Nov 03 20:21:11 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:12 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" returned: 0 in 0.411s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:21:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:21:12 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:21:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:12 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d Nov 03 20:21:12 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:19 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d" returned: 0 in 7.742s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:19 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1, size 1024.00 MB, duration 7.74 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:21:19 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Converted 1024.00 MB image at 132.25 MB/s Nov 03 20:21:19 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:20 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d Nov 03 20:21:20 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:20 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d" returned: 0 in 0.300s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-adef6b73-6cfa-4eaf-9069-8f0af440997d" released by "_copy_volume_from_snapshot" :: held 9.020s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-d69a2623-64b2-4b40-b485-c67b2ab52969-adef6b73-6cfa-4eaf-9069-8f0af440997d" released by "_create_volume_from_snapshot" :: held 9.111s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.138s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:20 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-6b25d46c-645d-49cc-ba70-daa4e1f0c709 tempest-GroupSnapshotsTest-1212772872 None] Create group from source-snapshot-3b0b64c0-775a-470c-a992-7a5a903c6754 completed successfully. Nov 03 20:21:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-adef6b73-6cfa-4eaf-9069-8f0af440997d" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-adef6b73-6cfa-4eaf-9069-8f0af440997d" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:22 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[170cac64-7a2a-4585-8c35-18dd7f8f2de5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:22 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d Nov 03 20:21:22 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:22 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d" returned: 0 in 0.489s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:22 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d Nov 03 20:21:22 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:22 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adef6b73-6cfa-4eaf-9069-8f0af440997d" returned: 0 in 0.329s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-adef6b73-6cfa-4eaf-9069-8f0af440997d" released by "delete_volume" :: held 0.897s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['29f7222c-1336-47f1-818b-6f2255510b71'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:23 devstack cinder-volume[87342]: WARNING cinder.quota [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2022260072 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2022260072, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:23 devstack cinder-volume[87342]: WARNING cinder.quota [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2022260072 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2022260072, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['a9abbeba-1989-49a3-8c23-32f7c69b9ef3', 'b053df23-9a48-411b-8391-894de860ad97', 'b149eb74-4be6-44e4-a845-68fdeb5ca8ba', '6ff0ef05-5bd1-4796-89d1-a452d624db45'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:23 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:21:23 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:23 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.325s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:23 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-07446304-b0f2-4863-a41b-a8a690f40ec0 tempest-GroupSnapshotsTest-1212772872 None] Delete group completed successfully. Nov 03 20:21:23 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] group_snapshot 3b0b64c0-775a-470c-a992-7a5a903c6754: deleting Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=72,cinder:INSERT=20,cinder:UPDATE=74,cinder:DELETE=9 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] group_snapshot 3b0b64c0-775a-470c-a992-7a5a903c6754: deleting {{(pid=87342) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:23 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:21:23 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-d69a2623-64b2-4b40-b485-c67b2ab52969" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-d69a2623-64b2-4b40-b485-c67b2ab52969" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Deleting offline snapshot d69a2623-64b2-4b40-b485-c67b2ab52969 of volume ed99254d-fd09-46d7-99c9-31f56b4cbbc1 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] snapshot_file for this snap is: volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03589f7-9241-4fe6-bc34-137dbb732984]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:24 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 Nov 03 20:21:24 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:24 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.549s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 8 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=76,cinder:SELECT=66,cinder:INSERT=17,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:24 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (e20dffd0-753a-4257-8672-6221623445bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1cf407-3fda-46c5-9640-7dba73fdafcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969" returned: 0 in 0.636s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1cf407-3fda-46c5-9640-7dba73fdafcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2099288710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df30bad1-964f-468c-97f8-c8c4c6c2df16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:24Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c10194f-ac55-4a9c-8a1d-adc4d41fe78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c10194f-ac55-4a9c-8a1d-adc4d41fe78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca3b9b6-9836-4092-a109-e7f2e421b315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca3b9b6-9836-4092-a109-e7f2e421b315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df30bad1-964f-468c-97f8-c8c4c6c2df16', 'volume_name': 'volume-df30bad1-964f-468c-97f8-c8c4c6c2df16', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938f70ab-1822-43c4-aa16-aa5417568afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938f70ab-1822-43c4-aa16-aa5417568afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878152c6-93d3-4949-902c-f52709987b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:24 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Volume df30bad1-964f-468c-97f8-c8c4c6c2df16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df30bad1-964f-468c-97f8-c8c4c6c2df16', 'volume_size': 1} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2099288710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df30bad1-964f-468c-97f8-c8c4c6c2df16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:24Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Creating volume df30bad1-964f-468c-97f8-c8c4c6c2df16 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:24 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88ad6a9-bc08-4e49-9bfa-f99a58d64557]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:24 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16 1073741824 Nov 03 20:21:24 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:24 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 Nov 03 20:21:24 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:25 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16 1073741824" returned: 0 in 0.471s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:25 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16 Nov 03 20:21:25 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:25 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" returned: 0 in 0.714s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:25 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 Nov 03 20:21:25 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:25 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16" returned: 0 in 0.358s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878152c6-93d3-4949-902c-f52709987b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df30bad1-964f-468c-97f8-c8c4c6c2df16', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1b3de4-e7af-4946-a1d6-6acd116d611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:25 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Volume volume-df30bad1-964f-468c-97f8-c8c4c6c2df16 (df30bad1-964f-468c-97f8-c8c4c6c2df16): created successfully Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1b3de4-e7af-4946-a1d6-6acd116d611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (e20dffd0-753a-4257-8672-6221623445bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ef69f8f5-852d-47d9-8a1d-33661535b510 tempest-VolumesActionsTest-1579289590 None] Created volume successfully. Nov 03 20:21:25 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969" returned: 0 in 0.395s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:25 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969 Nov 03 20:21:25 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:25 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1.d69a2623-64b2-4b40-b485-c67b2ab52969" returned: 0 in 0.238s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-d69a2623-64b2-4b40-b485-c67b2ab52969" released by "_delete_snapshot" :: held 2.193s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" released by "delete_snapshot" :: held 2.243s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:26 devstack cinder-volume[87342]: WARNING cinder.quota [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2022260072 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2022260072, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:26 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['519c6437-114f-49a4-9d3e-600dbdac7446', 'c8c20ada-b684-47b4-ac26-ba987d5cc097', 'df482f1c-6e2e-4e3f-925f-17446ec1b281', '0e8906d8-923e-47df-b5ad-f21b7ba1257d'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:26 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-842e3c83-38f2-4047-ad82-dcef1c952eea tempest-GroupSnapshotsTest-1212772872 None] group_snapshot 3b0b64c0-775a-470c-a992-7a5a903c6754: deleted successfully Nov 03 20:21:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0398f127-53a4-4d0c-bf19-1a6e9c935272 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16" by "attach_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0398f127-53a4-4d0c-bf19-1a6e9c935272 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16" acquired by "attach_volume" :: waited 0.064s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" acquired by "delete_volume" :: waited 0.058s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:26 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13718eb-d66c-49d9-a5fc-78f7933e7eae]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:26 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0398f127-53a4-4d0c-bf19-1a6e9c935272 tempest-VolumesActionsTest-1579289590 None] Attaching volume df30bad1-964f-468c-97f8-c8c4c6c2df16 to instance 55c09278-5ef8-47d2-ad05-9bac1e002122 at mountpoint /dev/vdb on host None. Nov 03 20:21:26 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0398f127-53a4-4d0c-bf19-1a6e9c935272 tempest-VolumesActionsTest-1579289590 None] Attach volume completed successfully. Nov 03 20:21:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0398f127-53a4-4d0c-bf19-1a6e9c935272 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16" released by "attach_volume" :: held 0.246s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:26 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 Nov 03 20:21:26 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:27 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" returned: 0 in 0.476s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:27 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1 Nov 03 20:21:27 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:27 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" returned: 0 in 0.299s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-ed99254d-fd09-46d7-99c9-31f56b4cbbc1" released by "delete_volume" :: held 0.874s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:27 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f7ff6968-d6c2-449c-bcf4-24dc616408e1 tempest-VolumesActionsTest-1778772771 None] Terminate volume connection completed successfully. Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f7ff6968-d6c2-449c-bcf4-24dc616408e1 tempest-VolumesActionsTest-1778772771 None] Acquiring lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16-detach_volume" by "detach_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f7ff6968-d6c2-449c-bcf4-24dc616408e1 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['62651eda-839c-48a0-929a-6900ccd876d4'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:27 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f7ff6968-d6c2-449c-bcf4-24dc616408e1 tempest-VolumesActionsTest-1778772771 None] Detaching volume df30bad1-964f-468c-97f8-c8c4c6c2df16 from instance 55c09278-5ef8-47d2-ad05-9bac1e002122. Nov 03 20:21:27 devstack cinder-volume[87342]: WARNING cinder.db.api [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2022260072'] Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['0eeb1bd0-8913-4015-9b5a-863018b88c0d', '4b651390-21b3-41f3-a6e4-d798b176f1b2', '87e4c534-44a8-4f2f-989c-aa645d2fd233', '8d7051dd-4fec-4610-bb5f-bdca6b9939d9'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:27 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f7ff6968-d6c2-449c-bcf4-24dc616408e1 tempest-VolumesActionsTest-1778772771 None] Detach volume completed successfully. Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f7ff6968-d6c2-449c-bcf4-24dc616408e1 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-aa5bf19c-1495-4f41-ba39-045d94af6569 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16-detach_volume" by "detach_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:27 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:21:27 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-aa5bf19c-1495-4f41-ba39-045d94af6569 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:28 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-aa5bf19c-1495-4f41-ba39-045d94af6569 tempest-VolumesActionsTest-1579289590 None] Volume detach called, but volume not attached. Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-aa5bf19c-1495-4f41-ba39-045d94af6569 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:28 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.296s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:28 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-46d4e80e-ae4d-42ac-ade6-800537766aa2 tempest-GroupSnapshotsTest-1212772872 None] Delete group completed successfully. Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "cinder-quobyte-df30bad1-964f-468c-97f8-c8c4c6c2df16" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-quobyte-df30bad1-964f-468c-97f8-c8c4c6c2df16" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[56179d4c-0c44-4bde-b0b0-eb3631ab8648]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:28 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16 Nov 03 20:21:28 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:28 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16" returned: 0 in 0.341s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:28 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16 Nov 03 20:21:28 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:29 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-df30bad1-964f-468c-97f8-c8c4c6c2df16" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-quobyte-df30bad1-964f-468c-97f8-c8c4c6c2df16" released by "delete_volume" :: held 0.660s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Created reservations ['bc7eec44-31fd-4750-a87f-1f1a456c5832', 'be75ccaf-cd16-4f24-b18e-3f9ea0d8972b', '66e60155-3842-4278-86b5-f4197f02876c', '5804ec96-13ff-4a38-b6d5-1026302faa6f'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:29 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:21:29 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:29 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.354s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:29 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Deleted volume successfully. Nov 03 20:21:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-78cc71c1-2a1f-4d53-947a-01a0b7e11639 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-df30bad1-964f-468c-97f8-c8c4c6c2df16-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:29 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-6be83497-1865-40e0-a862-07a55665bb84 tempest-GroupSnapshotsTest-1212772872 None] Group tempest-GroupSnapshotsTest-Group-329441296: creating Nov 03 20:21:29 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-6be83497-1865-40e0-a862-07a55665bb84 tempest-GroupSnapshotsTest-1212772872 None] Group tempest-GroupSnapshotsTest-Group-329441296: created successfully Nov 03 20:21:29 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-6be83497-1865-40e0-a862-07a55665bb84 tempest-GroupSnapshotsTest-1212772872 None] Create group completed successfully. Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Flow 'volume_create_manager' (7e49c503-4921-4ead-b166-d10597ca7c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53282106-7593-492b-a50c-3740432c84b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53282106-7593-492b-a50c-3740432c84b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1572145734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d84c10c-3b94-4db7-8643-9c99a1a3ceb1,host='devstack@QuobyteHD#QuobyteHD',id=65694023-553d-415a-893b-75b6d8c6e814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d55d7e75b154ca6b808bd760215e0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:31Z,use_quota=True,user_id='180d426648fd4a84b5e3fb004857bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afd98ee9-711b-4526-a5f8-777cd8a81817),volume_type_id=afd98ee9-711b-4526-a5f8-777cd8a81817)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e075ba3-8e25-4054-b2da-a51a335130ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e075ba3-8e25-4054-b2da-a51a335130ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8067ac6c-b513-4f47-a7b6-3b54e8ea067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8067ac6c-b513-4f47-a7b6-3b54e8ea067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65694023-553d-415a-893b-75b6d8c6e814', 'volume_name': 'volume-65694023-553d-415a-893b-75b6d8c6e814', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675df67a-3177-49be-a190-709581db97d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675df67a-3177-49be-a190-709581db97d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8254d52-de77-4466-b51c-8fb7cc638090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:31 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Volume 65694023-553d-415a-893b-75b6d8c6e814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65694023-553d-415a-893b-75b6d8c6e814', 'volume_size': 1} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7d84c10c-3b94-4db7-8643-9c99a1a3ceb1,created_at=2026-11-03T19:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1572145734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d84c10c-3b94-4db7-8643-9c99a1a3ceb1,host='devstack@QuobyteHD#QuobyteHD',id=65694023-553d-415a-893b-75b6d8c6e814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d55d7e75b154ca6b808bd760215e0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:31Z,use_quota=True,user_id='180d426648fd4a84b5e3fb004857bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afd98ee9-711b-4526-a5f8-777cd8a81817),volume_type_id=afd98ee9-711b-4526-a5f8-777cd8a81817)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Creating volume 65694023-553d-415a-893b-75b6d8c6e814 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:31 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:31 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 1073741824 Nov 03 20:21:31 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:31 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 1073741824" returned: 0 in 0.418s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:32 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 Nov 03 20:21:32 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:32 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814" returned: 0 in 0.287s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8254d52-de77-4466-b51c-8fb7cc638090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65694023-553d-415a-893b-75b6d8c6e814', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef1668b-25d4-46b9-be9b-b32a6292f57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:32 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Volume volume-65694023-553d-415a-893b-75b6d8c6e814 (65694023-553d-415a-893b-75b6d8c6e814): created successfully Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef1668b-25d4-46b9-be9b-b32a6292f57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Flow 'volume_create_manager' (7e49c503-4921-4ead-b166-d10597ca7c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:32 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ae405d60-c1b4-4d3a-9e6d-87e5723810bd tempest-GroupSnapshotsTest-1212772872 None] Created volume successfully. Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (77d4cdce-b4cf-4753-bbd3-960a4c6686ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c06b0db-c0e1-4f43-83d8-57d43bed3cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c06b0db-c0e1-4f43-83d8-57d43bed3cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1959979781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076d591d-929e-4c22-81de-4360f6d963bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:33Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52afd0f-22ab-4db9-a58f-91c88b15b988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52afd0f-22ab-4db9-a58f-91c88b15b988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5ef7c7-b68a-4f29-b6a0-7a143eb95212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5ef7c7-b68a-4f29-b6a0-7a143eb95212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '076d591d-929e-4c22-81de-4360f6d963bd', 'volume_name': 'volume-076d591d-929e-4c22-81de-4360f6d963bd', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482cd69f-078c-4f05-95bd-0c7a7d931c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482cd69f-078c-4f05-95bd-0c7a7d931c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff6d83c-28e0-43f9-9e9d-15cb86ef670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:32 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Volume 076d591d-929e-4c22-81de-4360f6d963bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-076d591d-929e-4c22-81de-4360f6d963bd', 'volume_size': 1} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1959979781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076d591d-929e-4c22-81de-4360f6d963bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:33Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Creating volume 076d591d-929e-4c22-81de-4360f6d963bd {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:32 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:21:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:32 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd 1073741824 Nov 03 20:21:32 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Flow 'volume_create_manager' (8ea2ceb1-5a5e-48ee-9851-e4e34a087004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2717a1-5482-4517-bd94-1f8395bda1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2717a1-5482-4517-bd94-1f8395bda1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959934737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d84c10c-3b94-4db7-8643-9c99a1a3ceb1,host='devstack@QuobyteHD#QuobyteHD',id=e99ec7a2-e1f1-44a2-9828-5fd7def44ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d55d7e75b154ca6b808bd760215e0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:33Z,use_quota=True,user_id='180d426648fd4a84b5e3fb004857bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afd98ee9-711b-4526-a5f8-777cd8a81817),volume_type_id=afd98ee9-711b-4526-a5f8-777cd8a81817)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da74dda6-c864-48ca-92af-0b4e3910693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da74dda6-c864-48ca-92af-0b4e3910693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b1c737-629a-429c-bf89-37884d9edb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b1c737-629a-429c-bf89-37884d9edb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e99ec7a2-e1f1-44a2-9828-5fd7def44ef5', 'volume_name': 'volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3f64d1-4349-40d6-9a6b-10830cd593bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3f64d1-4349-40d6-9a6b-10830cd593bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a3029a-0fed-4856-a5b1-32f24ed88dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:33 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Volume e99ec7a2-e1f1-44a2-9828-5fd7def44ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5', 'volume_size': 1} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:33 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd 1073741824" returned: 0 in 0.531s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:33 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd Nov 03 20:21:33 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:33 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd" returned: 0 in 0.244s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.377s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7d84c10c-3b94-4db7-8643-9c99a1a3ceb1,created_at=2026-11-03T19:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959934737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d84c10c-3b94-4db7-8643-9c99a1a3ceb1,host='devstack@QuobyteHD#QuobyteHD',id=e99ec7a2-e1f1-44a2-9828-5fd7def44ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d55d7e75b154ca6b808bd760215e0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:33Z,use_quota=True,user_id='180d426648fd4a84b5e3fb004857bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afd98ee9-711b-4526-a5f8-777cd8a81817),volume_type_id=afd98ee9-711b-4526-a5f8-777cd8a81817)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Creating volume e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:33 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:33 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 1073741824 Nov 03 20:21:33 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff6d83c-28e0-43f9-9e9d-15cb86ef670a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-076d591d-929e-4c22-81de-4360f6d963bd', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca89b65-1e9c-413d-a61b-853dd34c769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:33 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Volume volume-076d591d-929e-4c22-81de-4360f6d963bd (076d591d-929e-4c22-81de-4360f6d963bd): created successfully Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca89b65-1e9c-413d-a61b-853dd34c769f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (77d4cdce-b4cf-4753-bbd3-960a4c6686ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:33 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2061cc99-9941-4045-ac02-8eebdf00b8c7 tempest-VolumesActionsTest-1579289590 None] Created volume successfully. Nov 03 20:21:34 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 1073741824" returned: 0 in 0.408s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:34 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 Nov 03 20:21:34 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:34 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5" returned: 0 in 0.273s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a3029a-0fed-4856-a5b1-32f24ed88dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d58f44-a5d3-4df2-a71a-608ed1949dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:34 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Volume volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 (e99ec7a2-e1f1-44a2-9828-5fd7def44ef5): created successfully Nov 03 20:21:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d58f44-a5d3-4df2-a71a-608ed1949dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Flow 'volume_create_manager' (8ea2ceb1-5a5e-48ee-9851-e4e34a087004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:34 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a73b83c4-c6a0-4be4-9746-c4a3f18d34a0 tempest-GroupSnapshotsTest-1212772872 None] Created volume successfully. Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Acquiring lock "cinder-076d591d-929e-4c22-81de-4360f6d963bd-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-076d591d-929e-4c22-81de-4360f6d963bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Acquiring lock "cinder-quobyte-076d591d-929e-4c22-81de-4360f6d963bd" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-quobyte-076d591d-929e-4c22-81de-4360f6d963bd" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0457c3-37c6-4449-af69-5a16254e6bd9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:35 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd Nov 03 20:21:35 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:35 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd" returned: 0 in 0.355s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:35 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd Nov 03 20:21:35 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:35 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-962f1bed-3976-497b-9516-8cead28faf1d tempest-GroupSnapshotsTest-1212772872 None] Update group completed successfully. Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-076d591d-929e-4c22-81de-4360f6d963bd" returned: 0 in 0.286s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-quobyte-076d591d-929e-4c22-81de-4360f6d963bd" released by "delete_volume" :: held 0.687s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Created reservations ['3261c054-2bef-46d8-aaa2-2058751a51a2', '54eb8fa0-7633-4639-b655-38f77fed6f7a', '6995b3bf-94bf-46a2-93ad-36183bad8d8d', '88f6fa59-483c-49a2-8165-9d82b87ba077'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:35 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:21:35 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:36 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.269s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:36 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Deleted volume successfully. Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-124fd7fe-a0c3-4f15-8bc7-f5ecd1d8a6e9 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-076d591d-929e-4c22-81de-4360f6d963bd-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (fb819d34-8f71-4c9f-a688-c405bf9b6f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2376034b-c9ff-4a8d-9405-e50acddd845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2376034b-c9ff-4a8d-9405-e50acddd845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-841556579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fd53c5-0ace-407e-94b1-b8abddcdc52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:37Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cf6f66-c0b9-4f78-8792-c4956be71d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cf6f66-c0b9-4f78-8792-c4956be71d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64099263-eb19-48dd-aa40-ced93ff8134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64099263-eb19-48dd-aa40-ced93ff8134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53fd53c5-0ace-407e-94b1-b8abddcdc52f', 'volume_name': 'volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d91c00c-f495-44be-b59e-66667075bc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d91c00c-f495-44be-b59e-66667075bc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67851509-edba-4906-9c5a-24fb9cd41bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Volume 53fd53c5-0ace-407e-94b1-b8abddcdc52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f', 'volume_size': 1} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-841556579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fd53c5-0ace-407e-94b1-b8abddcdc52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:37Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Creating volume 53fd53c5-0ace-407e-94b1-b8abddcdc52f {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:36 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:21:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:36 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f 1073741824 Nov 03 20:21:36 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:36 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-9d0a3eaf-6e7f-4aa4-a3ce-0526d032bbbb tempest-GroupSnapshotsTest-1212772872 None] Update group completed successfully. Nov 03 20:21:37 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f 1073741824" returned: 0 in 0.460s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:37 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f Nov 03 20:21:37 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:37 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f" returned: 0 in 0.243s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67851509-edba-4906-9c5a-24fb9cd41bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ef938c-e1b1-4b54-9837-b065332205e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:37 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Volume volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f (53fd53c5-0ace-407e-94b1-b8abddcdc52f): created successfully Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ef938c-e1b1-4b54-9837-b065332205e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (fb819d34-8f71-4c9f-a688-c405bf9b6f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0d54ccee-0105-4f30-adad-0ce699135c10 tempest-VolumesActionsTest-1579289590 None] Created volume successfully. Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Acquiring lock "cinder-53fd53c5-0ace-407e-94b1-b8abddcdc52f-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-53fd53c5-0ace-407e-94b1-b8abddcdc52f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Acquiring lock "cinder-quobyte-53fd53c5-0ace-407e-94b1-b8abddcdc52f" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-quobyte-53fd53c5-0ace-407e-94b1-b8abddcdc52f" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c90e74c-88a4-4588-8da9-b86e87d7c25a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:38 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ffda9bfb-5238-4705-904c-90cd1e1d6c93 tempest-GroupSnapshotsTest-1212772872 None] Update group completed successfully. Nov 03 20:21:38 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f Nov 03 20:21:38 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:38 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f" returned: 0 in 0.391s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:38 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f Nov 03 20:21:38 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:38 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53fd53c5-0ace-407e-94b1-b8abddcdc52f" returned: 0 in 0.253s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-quobyte-53fd53c5-0ace-407e-94b1-b8abddcdc52f" released by "delete_volume" :: held 0.690s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Created reservations ['a1ea72eb-6170-428f-91e1-9d936b10e593', '39b0f00a-f8d7-4442-bfd1-a9accb3120c5', 'ecf6b666-5df6-4d52-b686-65444971e972', 'c48d704f-103a-48f8-b610-da4a5cd81195'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:38 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:21:38 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:39 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.253s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Deleted volume successfully. Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f61a7a00-0749-418b-8831-e328d1ae0377 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-53fd53c5-0ace-407e-94b1-b8abddcdc52f-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-aacb064d-ca85-4ca8-a4ba-6c8197e6d307 tempest-GroupSnapshotsTest-1212772872 None] Update group completed successfully. Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (b9b1165b-210f-4665-94a4-0a5b89c1858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa1466b-a1db-4895-b7de-3ad5f877233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa1466b-a1db-4895-b7de-3ad5f877233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-511450950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2448a1-abf5-4016-bda8-504fa4cb752b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:40Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a69de8-1cc8-4edd-9e82-b94d72e5eb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a69de8-1cc8-4edd-9e82-b94d72e5eb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23c63ce-2443-427b-b567-b3a7698bcdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23c63ce-2443-427b-b567-b3a7698bcdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2448a1-abf5-4016-bda8-504fa4cb752b', 'volume_name': 'volume-3e2448a1-abf5-4016-bda8-504fa4cb752b', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa77e84-5bf6-46f7-906d-ad12f4fae804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa77e84-5bf6-46f7-906d-ad12f4fae804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5e1b27-808d-4fdd-a7fc-455af952e374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:39 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Volume 3e2448a1-abf5-4016-bda8-504fa4cb752b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2448a1-abf5-4016-bda8-504fa4cb752b', 'volume_size': 1} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-511450950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2448a1-abf5-4016-bda8-504fa4cb752b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:40Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Creating volume 3e2448a1-abf5-4016-bda8-504fa4cb752b {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:39 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:21:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:39 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b 1073741824 Nov 03 20:21:39 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:40 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b 1073741824" returned: 0 in 0.423s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:40 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b Nov 03 20:21:40 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:40 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5e1b27-808d-4fdd-a7fc-455af952e374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2448a1-abf5-4016-bda8-504fa4cb752b', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b986f8e-04b3-41c5-ac06-dcfbf1bdd14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:40 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Volume volume-3e2448a1-abf5-4016-bda8-504fa4cb752b (3e2448a1-abf5-4016-bda8-504fa4cb752b): created successfully Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b986f8e-04b3-41c5-ac06-dcfbf1bdd14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (b9b1165b-210f-4665-94a4-0a5b89c1858e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c2074cfa-58bc-4fbb-95c3-713be0ddbd39 tempest-VolumesActionsTest-1579289590 None] Created volume successfully. Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Acquiring lock "cinder-3e2448a1-abf5-4016-bda8-504fa4cb752b-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-3e2448a1-abf5-4016-bda8-504fa4cb752b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Acquiring lock "cinder-quobyte-3e2448a1-abf5-4016-bda8-504fa4cb752b" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-quobyte-3e2448a1-abf5-4016-bda8-504fa4cb752b" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] GroupSnapshot a4f0826d-0dde-45ee-8ad4-fb75d8e410d8: creating. Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d4c83-6a97-4e48-bb51-1467609eef9b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Group snapshot a4f0826d-0dde-45ee-8ad4-fb75d8e410d8: creating. {{(pid=87342) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Creating offline snapshot 5ced6db3-5d43-455a-bcfb-0f39d7165685 of volume 65694023-553d-415a-893b-75b6d8c6e814 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0431b0bf-c4d0-486b-85e5-8f3009453954]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:41 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b Nov 03 20:21:41 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:41 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 Nov 03 20:21:41 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:41 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b" returned: 0 in 0.403s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:41 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b Nov 03 20:21:41 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:41 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814" returned: 0 in 0.401s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:41 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 1G Nov 03 20:21:41 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:41 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3e2448a1-abf5-4016-bda8-504fa4cb752b" returned: 0 in 0.263s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-quobyte-3e2448a1-abf5-4016-bda8-504fa4cb752b" released by "delete_volume" :: held 0.742s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Created reservations ['02a21ec2-59c8-4419-bb85-d7933df02947', '98a983e8-27af-4a01-ad55-56211f3af37c', 'c860feb6-e363-418e-b4f6-4f6a15d3e0fa', '719c93c2-c827-4f45-bb7a-cfe5bfead1da'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:41 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:21:41 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:41 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 1G" returned: 0 in 0.455s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65694023-553d-415a-893b-75b6d8c6e814 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:41 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65694023-553d-415a-893b-75b6d8c6e814 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 Nov 03 20:21:41 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:41 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.294s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:41 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Deleted volume successfully. Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc95215c-60a4-4740-ae4f-9a3f82f4b835 tempest-VolumesActionsTest-1778772771 None] Lock "cinder-3e2448a1-abf5-4016-bda8-504fa4cb752b-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:42 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65694023-553d-415a-893b-75b6d8c6e814 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685" returned: 0 in 0.357s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:42 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:42 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 Nov 03 20:21:42 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:42 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685" returned: 0 in 0.270s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:42 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.info Nov 03 20:21:42 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (492ac420-7d3a-4a87-9978-5894020a912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05327712-b06e-481c-83b0-80530bfb5582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05327712-b06e-481c-83b0-80530bfb5582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-641749568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e391e98-3481-4391-b534-7eec0c613cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:42Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f13647a-8907-4d8c-b902-e5567b530e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f13647a-8907-4d8c-b902-e5567b530e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078bf033-2e7c-4198-9d90-109a862ea6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078bf033-2e7c-4198-9d90-109a862ea6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e391e98-3481-4391-b534-7eec0c613cb7', 'volume_name': 'volume-0e391e98-3481-4391-b534-7eec0c613cb7', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f0a1c9-2aa4-4ad5-81fc-32c07eb39c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f0a1c9-2aa4-4ad5-81fc-32c07eb39c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fa1d9b-010a-4f25-b64b-6123cee8e432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:42 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Volume 0e391e98-3481-4391-b534-7eec0c613cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e391e98-3481-4391-b534-7eec0c613cb7', 'volume_size': 1} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:42 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.info" returned: 0 in 0.243s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:42 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:42 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.info Nov 03 20:21:42 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:42 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.info" returned: 0 in 0.239s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Creating offline snapshot ebb35894-d879-4f45-96d7-cd0a88fc2a96 of volume e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:21:43 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e96ca61-488c-46ee-a435-c68fa3ed1bcf]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:43 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 Nov 03 20:21:43 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:43 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5" returned: 0 in 0.382s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:43 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 1G Nov 03 20:21:43 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:43 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 1G" returned: 0 in 0.386s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:43 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 Nov 03 20:21:43 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:44 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96" returned: 0 in 0.277s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:44 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:44 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 Nov 03 20:21:44 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:44 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96" returned: 0 in 0.257s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:44 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.info Nov 03 20:21:44 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:44 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.info" returned: 0 in 0.278s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:44 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:44 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.info Nov 03 20:21:44 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:44 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.info" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.341s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-641749568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e391e98-3481-4391-b534-7eec0c613cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:42Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Creating volume 0e391e98-3481-4391-b534-7eec0c613cb7 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:44 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:21:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:44 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7 1073741824 Nov 03 20:21:44 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-533eb9f7-a999-4129-952d-5eeb1c3b71a3 tempest-GroupSnapshotsTest-1212772872 None] group_snapshot a4f0826d-0dde-45ee-8ad4-fb75d8e410d8: created successfully Nov 03 20:21:45 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7 1073741824" returned: 0 in 0.442s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:45 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7 Nov 03 20:21:45 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:45 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7" returned: 0 in 0.242s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fa1d9b-010a-4f25-b64b-6123cee8e432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e391e98-3481-4391-b534-7eec0c613cb7', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53977a7c-7119-4657-be0d-b44ff54885e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:45 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Volume volume-0e391e98-3481-4391-b534-7eec0c613cb7 (0e391e98-3481-4391-b534-7eec0c613cb7): created successfully Nov 03 20:21:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53977a7c-7119-4657-be0d-b44ff54885e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (492ac420-7d3a-4a87-9978-5894020a912d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-26ff9113-d95f-4532-a822-bfd92469844b tempest-VolumesActionsTest-1579289590 None] Created volume successfully. Nov 03 20:21:46 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] group_snapshot a4f0826d-0dde-45ee-8ad4-fb75d8e410d8: deleting Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] group_snapshot a4f0826d-0dde-45ee-8ad4-fb75d8e410d8: deleting {{(pid=87342) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-65694023-553d-415a-893b-75b6d8c6e814" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-65694023-553d-415a-893b-75b6d8c6e814" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-5ced6db3-5d43-455a-bcfb-0f39d7165685" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-5ced6db3-5d43-455a-bcfb-0f39d7165685" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Deleting offline snapshot 5ced6db3-5d43-455a-bcfb-0f39d7165685 of volume 65694023-553d-415a-893b-75b6d8c6e814 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] snapshot_file for this snap is: volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d4a063-044e-40e7-bf35-a72f103041a4]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:46 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 Nov 03 20:21:46 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:46 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685" returned: 0 in 0.379s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65694023-553d-415a-893b-75b6d8c6e814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd50e2-2443-4b23-9a8f-955372de72c4]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Acquiring lock "cinder-0e391e98-3481-4391-b534-7eec0c613cb7-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Lock "cinder-0e391e98-3481-4391-b534-7eec0c613cb7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Acquiring lock "cinder-quobyte-0e391e98-3481-4391-b534-7eec0c613cb7" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:46 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 Nov 03 20:21:46 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Lock "cinder-quobyte-0e391e98-3481-4391-b534-7eec0c613cb7" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2dc9c8-f6b6-4510-ad83-ee982ed945b3]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:47 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7 Nov 03 20:21:47 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:47 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814" returned: 0 in 0.403s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:47 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 Nov 03 20:21:47 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:47 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7" returned: 0 in 0.400s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:47 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7 Nov 03 20:21:47 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:47 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685" returned: 0 in 0.339s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:47 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685 Nov 03 20:21:47 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:47 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-0e391e98-3481-4391-b534-7eec0c613cb7" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Lock "cinder-quobyte-0e391e98-3481-4391-b534-7eec0c613cb7" released by "delete_volume" :: held 0.711s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Created reservations ['db2c258c-8ef2-48f5-9648-c4c640b2da6c', '613f7623-d45b-40df-9b32-b30ac73308fd', '27ad4cdd-aa4e-4aad-9fe1-5d7c507fa25b', '4abfc326-cec5-4abf-ba5c-71a9f5cabcb8'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:47 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:21:47 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:47 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814.5ced6db3-5d43-455a-bcfb-0f39d7165685" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-5ced6db3-5d43-455a-bcfb-0f39d7165685" released by "_delete_snapshot" :: held 1.488s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-65694023-553d-415a-893b-75b6d8c6e814" released by "delete_snapshot" :: held 1.508s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-ebb35894-d879-4f45-96d7-cd0a88fc2a96" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-ebb35894-d879-4f45-96d7-cd0a88fc2a96" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Deleting offline snapshot ebb35894-d879-4f45-96d7-cd0a88fc2a96 of volume e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] snapshot_file for this snap is: volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e93ea0c-91b7-4e4b-a0e6-e3e8ba7a5602]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:47 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 Nov 03 20:21:47 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:48 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.290s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:48 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Deleted volume successfully. Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5914b274-af03-488a-9552-a7130afd9f8c tempest-VolumesActionsTest-1778772771 None] Lock "cinder-0e391e98-3481-4391-b534-7eec0c613cb7-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:48 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96" returned: 0 in 0.410s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8918a7b3-efa8-4fdb-839b-6c0e5713771b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:48 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 Nov 03 20:21:48 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (759e2469-44ec-43f6-9483-0c07f4297831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7f8c40-f139-42be-8838-1a319f8a7f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7f8c40-f139-42be-8838-1a319f8a7f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-411078189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:48Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec472666-1bc6-4380-b396-b4ae1695c469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec472666-1bc6-4380-b396-b4ae1695c469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29acd8f4-90ad-428c-a6ca-df9cd1193c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29acd8f4-90ad-428c-a6ca-df9cd1193c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3', 'volume_name': 'volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca733bf-d820-4216-ae09-a8362ba4076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca733bf-d820-4216-ae09-a8362ba4076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f818759-dd5a-4e6f-a365-d4cccb5da24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:48 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Volume 3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3', 'volume_size': 1} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-411078189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf3a32530354784b4bffbe1cd3aabad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:48Z,use_quota=True,user_id='c432bb90ee534411b4e991b855b0c998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Creating volume 3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:48 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:48 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3 1073741824 Nov 03 20:21:48 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:48 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5" returned: 0 in 0.414s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:48 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 Nov 03 20:21:48 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:49 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3 1073741824" returned: 0 in 0.443s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:49 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96" returned: 0 in 0.371s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:49 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3 Nov 03 20:21:49 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:49 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96 Nov 03 20:21:49 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:49 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3" returned: 0 in 0.263s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f818759-dd5a-4e6f-a365-d4cccb5da24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:49 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d79bf35-3ec1-4c5a-ba7c-31cca7dc892c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5.ebb35894-d879-4f45-96d7-cd0a88fc2a96" returned: 0 in 0.281s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-ebb35894-d879-4f45-96d7-cd0a88fc2a96" released by "_delete_snapshot" :: held 1.622s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:49 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Volume volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3 (3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3): created successfully Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d79bf35-3ec1-4c5a-ba7c-31cca7dc892c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Flow 'volume_create_manager' (759e2469-44ec-43f6-9483-0c07f4297831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5" released by "delete_snapshot" :: held 1.655s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:49 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-36c87151-4ce3-4bd8-b09d-463d06ae04e8 tempest-VolumesActionsTest-1579289590 None] Created volume successfully. Nov 03 20:21:49 devstack cinder-volume[87342]: WARNING cinder.quota [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1744576763 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1744576763, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:49 devstack cinder-volume[87342]: WARNING cinder.quota [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1744576763 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1744576763, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['9d318679-f181-45be-b47c-460f05f4ba54', 'ce6c8f24-7f9d-4b78-b48e-611a10e41e79', '844838f5-9162-4281-816c-508aa6b0c3e1', 'a37811e6-e117-4f2c-b915-2884a41933bd'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:49 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['3f5d84c0-7ae9-41fb-8fab-47d8959a4c24', 'd5a41fc2-bf01-4139-a087-2bec3b3f959d', 'e131723a-ba25-4e47-bfd2-69b19e937992', '6f232fce-80b5-4c2d-a7cc-6e551f1446e3'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:49 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-819410ca-6a51-44b0-85c1-f028c6e80c0e tempest-GroupSnapshotsTest-1212772872 None] group_snapshot a4f0826d-0dde-45ee-8ad4-fb75d8e410d8: deleted successfully Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-65694023-553d-415a-893b-75b6d8c6e814" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-65694023-553d-415a-893b-75b6d8c6e814" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[992409fe-56f5-47c8-8db0-49e31c5019f8]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "cinder-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:51 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 Nov 03 20:21:51 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "cinder-quobyte-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-quobyte-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3" acquired by "delete_volume" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[389da86f-7f32-4de9-9c8b-8d5cd4ee0f1a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:51 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3 Nov 03 20:21:51 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-4a134e04-3332-46f1-9800-2b3b18fa3830 req-5d3c4bf1-6228-4721-bbdd-1c8a41490875 tempest-AttachVolumeTestJSON-1745915254 None] Terminate volume connection completed successfully. Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-4a134e04-3332-46f1-9800-2b3b18fa3830 req-5d3c4bf1-6228-4721-bbdd-1c8a41490875 tempest-AttachVolumeTestJSON-1745915254 None] Deleting attachment 3353ab7d-2f24-44c3-96b3-bf2388adb88a. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:21:51 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814" returned: 0 in 0.500s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:51 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814 Nov 03 20:21:51 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:51 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3" returned: 0 in 0.396s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:51 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3 Nov 03 20:21:51 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:52 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-65694023-553d-415a-893b-75b6d8c6e814" returned: 0 in 0.275s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-65694023-553d-415a-893b-75b6d8c6e814" released by "delete_volume" :: held 0.862s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5" acquired by "delete_volume" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7b6c17-0765-4d05-b36f-1116471a74f4]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:52 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3" returned: 0 in 0.268s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-quobyte-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3" released by "delete_volume" :: held 0.732s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:52 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 Nov 03 20:21:52 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Created reservations ['333f09ae-fbf6-4954-8dce-b707787df88b', '13721686-6428-4b4d-8398-c79c54cebd07', '7dafd07d-17ba-42ff-95ce-a7ef8eaf69a5', 'ee51b055-715f-47bf-8f12-2e375dbf1901'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:52 devstack sudo[92893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:21:52 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:52 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5" returned: 0 in 0.425s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:52 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5 Nov 03 20:21:52 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:52 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.277s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:52 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Deleted volume successfully. Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e075f17e-e08a-4368-8a26-f605d36c0899 tempest-VolumesActionsTest-1579289590 None] Lock "cinder-3ddfd0df-f3cd-4b46-b2a0-7aedfefc01e3-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:52 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5" returned: 0 in 0.294s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-e99ec7a2-e1f1-44a2-9828-5fd7def44ef5" released by "delete_volume" :: held 0.779s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['73aaf644-f330-4f13-a1b4-14dd11c7f3ba'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:52 devstack cinder-volume[87342]: WARNING cinder.quota [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1744576763 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1744576763, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:52 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['c5258efd-aa7d-49de-b8b9-c5cf84ac518b', 'cef46d2a-3bd4-4924-9c41-10bbbf1c2105', '84ff5f14-3879-4946-897c-76307ced4271', 'e70adc36-24be-4314-b003-75e4f60f9cdf'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:53 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['0b8d6325-ef16-4697-9e09-6206054092a3', 'c22ae8f0-a015-4178-8ea2-75cb1b00761f', '28030a9f-5796-46b1-8cef-1a725d1737f5', '4d5086d4-4f4d-4b8e-bca8-8c648dd94af2'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:53 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:21:53 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:53 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.325s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:53 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:53 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8d90922a-72d0-4235-a88e-30a271f9a444 tempest-GroupSnapshotsTest-1212772872 None] Delete group completed successfully. Nov 03 20:21:54 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b22c9624-df4c-4f17-9831-0b8adbe49dc2 tempest-GroupSnapshotsTest-1212772872 None] Group tempest-GroupSnapshotsTest-Group-1530115715: creating Nov 03 20:21:54 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b22c9624-df4c-4f17-9831-0b8adbe49dc2 tempest-GroupSnapshotsTest-1212772872 None] Group tempest-GroupSnapshotsTest-Group-1530115715: created successfully Nov 03 20:21:54 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b22c9624-df4c-4f17-9831-0b8adbe49dc2 tempest-GroupSnapshotsTest-1212772872 None] Create group completed successfully. Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Flow 'volume_create_manager' (1efc2b7e-0b18-4700-9045-7eab3dfe349e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbc72fa-e27d-43b0-902e-460ce6d64be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbc72fa-e27d-43b0-902e-460ce6d64be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-752577642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dccff44c-2f4b-4d37-914d-403fc6ec550e,host='devstack@QuobyteHD#QuobyteHD',id=4a1550fd-a5db-48da-85d2-43fe161511cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d55d7e75b154ca6b808bd760215e0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:56Z,use_quota=True,user_id='180d426648fd4a84b5e3fb004857bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a857a425-d7bc-4a8d-8f2a-3fcd9ab0c72e),volume_type_id=a857a425-d7bc-4a8d-8f2a-3fcd9ab0c72e)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37245c09-dd51-4a22-b3d7-a19041172888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37245c09-dd51-4a22-b3d7-a19041172888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052e6272-a1d3-49e0-8d93-9b8ecfd773e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052e6272-a1d3-49e0-8d93-9b8ecfd773e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1550fd-a5db-48da-85d2-43fe161511cb', 'volume_name': 'volume-4a1550fd-a5db-48da-85d2-43fe161511cb', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2ff176-7016-45db-bc45-34ea3c8a91d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2ff176-7016-45db-bc45-34ea3c8a91d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c313af7a-0662-4a5a-8507-945675211345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:55 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Volume 4a1550fd-a5db-48da-85d2-43fe161511cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1550fd-a5db-48da-85d2-43fe161511cb', 'volume_size': 1} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dccff44c-2f4b-4d37-914d-403fc6ec550e,created_at=2026-11-03T19:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-752577642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dccff44c-2f4b-4d37-914d-403fc6ec550e,host='devstack@QuobyteHD#QuobyteHD',id=4a1550fd-a5db-48da-85d2-43fe161511cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d55d7e75b154ca6b808bd760215e0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:56Z,use_quota=True,user_id='180d426648fd4a84b5e3fb004857bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a857a425-d7bc-4a8d-8f2a-3fcd9ab0c72e),volume_type_id=a857a425-d7bc-4a8d-8f2a-3fcd9ab0c72e)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Creating volume 4a1550fd-a5db-48da-85d2-43fe161511cb {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:55 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:21:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:55 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb 1073741824 Nov 03 20:21:55 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:56 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb 1073741824" returned: 0 in 0.614s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:56 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb Nov 03 20:21:56 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:56 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb" returned: 0 in 0.305s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c313af7a-0662-4a5a-8507-945675211345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1550fd-a5db-48da-85d2-43fe161511cb', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed351b2-77a2-495b-8110-f07255781d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:56 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Volume volume-4a1550fd-a5db-48da-85d2-43fe161511cb (4a1550fd-a5db-48da-85d2-43fe161511cb): created successfully Nov 03 20:21:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed351b2-77a2-495b-8110-f07255781d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Flow 'volume_create_manager' (1efc2b7e-0b18-4700-9045-7eab3dfe349e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:56 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-40d2492f-3dc6-4678-bc84-c79fe11a59c2 tempest-GroupSnapshotsTest-1212772872 None] Created volume successfully. Nov 03 20:21:58 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] GroupSnapshot 5a5f2019-6df7-4401-ab3f-44d9fa72ab2d: creating. Nov 03 20:21:58 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] Group snapshot 5a5f2019-6df7-4401-ab3f-44d9fa72ab2d: creating. {{(pid=87342) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 20:21:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] Creating offline snapshot fba20bdc-0bb6-4b0c-9519-7b368d421586 of volume 4a1550fd-a5db-48da-85d2-43fe161511cb {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:21:58 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[48504142-11f2-41ce-8efb-4cad613f1f1a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:58 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb Nov 03 20:21:58 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:59 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb" returned: 0 in 0.449s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:59 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 1G Nov 03 20:21:59 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:59 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 1G" returned: 0 in 0.519s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1550fd-a5db-48da-85d2-43fe161511cb -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:59 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1550fd-a5db-48da-85d2-43fe161511cb -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 Nov 03 20:21:59 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:59 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1550fd-a5db-48da-85d2-43fe161511cb -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586" returned: 0 in 0.340s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:59 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:59 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 Nov 03 20:21:59 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:00 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586" returned: 0 in 0.325s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:00 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.info Nov 03 20:22:00 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:00 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.info" returned: 0 in 0.264s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:00 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:22:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:00 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.info Nov 03 20:22:00 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:00 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.info" returned: 0 in 0.303s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.310s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:00 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4d43692d-139a-47d6-8731-5f920a954e8f tempest-GroupSnapshotsTest-1212772872 None] group_snapshot 5a5f2019-6df7-4401-ab3f-44d9fa72ab2d: created successfully Nov 03 20:22:01 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] group_snapshot 5a5f2019-6df7-4401-ab3f-44d9fa72ab2d: deleting Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] group_snapshot 5a5f2019-6df7-4401-ab3f-44d9fa72ab2d: deleting {{(pid=87342) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-4a1550fd-a5db-48da-85d2-43fe161511cb" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-4a1550fd-a5db-48da-85d2-43fe161511cb" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-fba20bdc-0bb6-4b0c-9519-7b368d421586" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-fba20bdc-0bb6-4b0c-9519-7b368d421586" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Deleting offline snapshot fba20bdc-0bb6-4b0c-9519-7b368d421586 of volume 4a1550fd-a5db-48da-85d2-43fe161511cb {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] snapshot_file for this snap is: volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff90e537-1754-4a11-a14b-debb043e8b4e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:02 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 Nov 03 20:22:02 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:02 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586" returned: 0 in 0.517s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a1550fd-a5db-48da-85d2-43fe161511cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5db017-5bc2-43b4-9012-fb9a5e24e1a7]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:02 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb Nov 03 20:22:02 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:03 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb" returned: 0 in 0.415s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:03 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 Nov 03 20:22:03 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:03 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586" returned: 0 in 0.437s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:03 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586 Nov 03 20:22:03 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:03 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb.fba20bdc-0bb6-4b0c-9519-7b368d421586" returned: 0 in 0.290s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-fba20bdc-0bb6-4b0c-9519-7b368d421586" released by "_delete_snapshot" :: held 1.853s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-4a1550fd-a5db-48da-85d2-43fe161511cb" released by "delete_snapshot" :: held 1.904s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:04 devstack cinder-volume[87342]: WARNING cinder.quota [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-507427457 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-507427457, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:22:04 devstack cinder-volume[87342]: WARNING cinder.quota [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-507427457 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-507427457, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:22:04 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['5bd94a4d-92c0-41a3-b14a-bcc951dd3747', 'd27b142a-366c-4313-bc9d-ab2f0e65e3dc', '0f360f6f-d6c4-4319-8672-eef72cef4fba', '29589970-0ac6-40ad-8cb5-4df9d6e492e8'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b88deaa3-aa5e-4a24-a480-ca4449655c57 tempest-GroupSnapshotsTest-1212772872 None] group_snapshot 5a5f2019-6df7-4401-ab3f-44d9fa72ab2d: deleted successfully Nov 03 20:22:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "cinder-quobyte-4a1550fd-a5db-48da-85d2-43fe161511cb" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-4a1550fd-a5db-48da-85d2-43fe161511cb" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:04 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8617fb75-c4c0-4eac-b855-170f51b93cb0]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:04 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb Nov 03 20:22:04 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:05 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb" returned: 0 in 0.694s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:05 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb Nov 03 20:22:05 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:06 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4a1550fd-a5db-48da-85d2-43fe161511cb" returned: 0 in 0.609s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Lock "cinder-quobyte-4a1550fd-a5db-48da-85d2-43fe161511cb" released by "delete_volume" :: held 1.451s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:06 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['9f731d5f-3ce0-4b42-949d-7901570b0365'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:06 devstack cinder-volume[87342]: WARNING cinder.quota [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-507427457 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-507427457, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:22:06 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Created reservations ['3c72fd7e-0290-41c5-a843-c0554d6edd01', '366be958-94cb-4c20-94a9-4e0f1a3688d4', 'd77fe839-2d9d-4b29-8bfc-002419408843', 'c2f10c90-950d-4161-adfd-fa10684b4b06'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:06 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:06 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:07 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.396s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:07 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:07 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-64bde2a9-1308-4fcd-aae7-50d645e7ab91 tempest-GroupSnapshotsTest-1212772872 None] Delete group completed successfully. Nov 03 20:22:13 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Flow 'volume_create_manager' (0c7b5403-d211-4193-bdc7-70a1c4c11cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29af3dfe-1059-4541-9459-4f5726320dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29af3dfe-1059-4541-9459-4f5726320dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1976639199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c988982c-d572-4434-9000-a749a9bab40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89689232e5274d13ad3e801d9d1d2b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:14Z,use_quota=True,user_id='035e1fdbb5334e3fa86ecd15cf75daa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f58be8-e597-467c-bb85-6a45d9893120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f58be8-e597-467c-bb85-6a45d9893120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72ab512-f185-469d-9545-c74ff6e382b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72ab512-f185-469d-9545-c74ff6e382b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c988982c-d572-4434-9000-a749a9bab40e', 'volume_name': 'volume-c988982c-d572-4434-9000-a749a9bab40e', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd85bd67-5ce2-4f95-a1cf-26d3e22c9d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd85bd67-5ce2-4f95-a1cf-26d3e22c9d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbd9077-b519-409e-ac69-50b06d39a0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:14 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Volume c988982c-d572-4434-9000-a749a9bab40e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c988982c-d572-4434-9000-a749a9bab40e', 'volume_size': 1} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1976639199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c988982c-d572-4434-9000-a749a9bab40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89689232e5274d13ad3e801d9d1d2b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:14Z,use_quota=True,user_id='035e1fdbb5334e3fa86ecd15cf75daa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Creating volume c988982c-d572-4434-9000-a749a9bab40e {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:14 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:14 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e 1073741824 Nov 03 20:22:14 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:14 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e 1073741824" returned: 0 in 0.519s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:14 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e Nov 03 20:22:14 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:14 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e" returned: 0 in 0.283s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbd9077-b519-409e-ac69-50b06d39a0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c988982c-d572-4434-9000-a749a9bab40e', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b83c28b-a4f8-4fee-a5a3-fcc266fe0f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:14 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Volume volume-c988982c-d572-4434-9000-a749a9bab40e (c988982c-d572-4434-9000-a749a9bab40e): created successfully Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b83c28b-a4f8-4fee-a5a3-fcc266fe0f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Flow 'volume_create_manager' (0c7b5403-d211-4193-bdc7-70a1c4c11cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:14 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-62849499-65ec-4908-8a4b-e6ff22525391 tempest-VolumesTransfersV355Test-1589320684 None] Created volume successfully. Nov 03 20:22:15 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5a2a426d-f45f-434b-8f46-c8c5effb37dc tempest-GroupSnapshotsV319Test-2099816977 None] Group tempest-GroupSnapshotsV319Test-Group-1571837879: creating Nov 03 20:22:15 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5a2a426d-f45f-434b-8f46-c8c5effb37dc tempest-GroupSnapshotsV319Test-2099816977 None] Group tempest-GroupSnapshotsV319Test-Group-1571837879: created successfully Nov 03 20:22:15 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5a2a426d-f45f-434b-8f46-c8c5effb37dc tempest-GroupSnapshotsV319Test-2099816977 None] Create group completed successfully. Nov 03 20:22:16 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d94a4b20-d8dd-4ca5-9046-5ae163e4b3eb tempest-VolumesTransfersV355Test-177898161 None] Transfer volume completed successfully. Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Flow 'volume_create_manager' (40118bdd-8a26-4031-a54b-ad8c8ca8ba39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0217d91c-d7b7-4343-a150-c1bec3fd320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0217d91c-d7b7-4343-a150-c1bec3fd320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-452517796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2aa7b524-1845-474e-a90a-181fc8f72645,host='devstack@QuobyteHD#QuobyteHD',id=7dc45282-a5a7-49d1-990e-ac126bb13aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534afa4c4408444f9cb445d1855881be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:17Z,use_quota=True,user_id='0101fdef921d4b4389b1e7125fa4515e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf468728-a297-445a-9cbc-0cf0bb77e278),volume_type_id=cf468728-a297-445a-9cbc-0cf0bb77e278)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b68076-bfe3-41be-ae17-4862fd751845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b68076-bfe3-41be-ae17-4862fd751845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99ea69c-fcfa-4171-a085-364ffcdc1c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99ea69c-fcfa-4171-a085-364ffcdc1c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dc45282-a5a7-49d1-990e-ac126bb13aa3', 'volume_name': 'volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af0337f-0071-4a1c-8414-3c793c46e4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af0337f-0071-4a1c-8414-3c793c46e4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1979fe3c-3552-49ce-861e-d770c78bfcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:17 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Volume 7dc45282-a5a7-49d1-990e-ac126bb13aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3', 'volume_size': 1} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2aa7b524-1845-474e-a90a-181fc8f72645,created_at=2026-11-03T19:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-452517796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2aa7b524-1845-474e-a90a-181fc8f72645,host='devstack@QuobyteHD#QuobyteHD',id=7dc45282-a5a7-49d1-990e-ac126bb13aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534afa4c4408444f9cb445d1855881be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:17Z,use_quota=True,user_id='0101fdef921d4b4389b1e7125fa4515e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf468728-a297-445a-9cbc-0cf0bb77e278),volume_type_id=cf468728-a297-445a-9cbc-0cf0bb77e278)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Creating volume 7dc45282-a5a7-49d1-990e-ac126bb13aa3 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:17 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:17 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 1073741824 Nov 03 20:22:17 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Acquiring lock "cinder-c988982c-d572-4434-9000-a749a9bab40e-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Lock "cinder-c988982c-d572-4434-9000-a749a9bab40e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Acquiring lock "cinder-quobyte-c988982c-d572-4434-9000-a749a9bab40e" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Lock "cinder-quobyte-c988982c-d572-4434-9000-a749a9bab40e" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[074182ad-e437-4299-8afb-46487ebfc3d4]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:17 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 1073741824" returned: 0 in 0.493s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:17 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e Nov 03 20:22:17 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 Nov 03 20:22:17 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:17 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:17 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3" returned: 0 in 0.271s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:17 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1979fe3c-3552-49ce-861e-d770c78bfcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b201fc-45b5-4869-8a86-cd50d9ff710a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e" returned: 0 in 0.386s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:18 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Volume volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 (7dc45282-a5a7-49d1-990e-ac126bb13aa3): created successfully Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b201fc-45b5-4869-8a86-cd50d9ff710a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:18 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e Nov 03 20:22:18 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Flow 'volume_create_manager' (40118bdd-8a26-4031-a54b-ad8c8ca8ba39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:18 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4d73b5f8-451f-4f08-aeee-c06b9d51801e tempest-GroupSnapshotsV319Test-2099816977 None] Created volume successfully. Nov 03 20:22:18 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c988982c-d572-4434-9000-a749a9bab40e" returned: 0 in 0.266s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Lock "cinder-quobyte-c988982c-d572-4434-9000-a749a9bab40e" released by "delete_volume" :: held 0.706s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Created reservations ['25f01d17-d7d3-40e4-b4ad-928dac533553', 'f2558c74-9cab-4c74-892c-4d27835792c5', '5917e301-28b7-419a-a87e-44bb9b5b362f', '06894679-4faf-45ee-9da6-c9db6d34d1d3'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:18 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:18 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:18 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] GroupSnapshot 2418727d-8c65-44c8-8968-9352637099ad: creating. Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] Group snapshot 2418727d-8c65-44c8-8968-9352637099ad: creating. {{(pid=87342) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] Creating offline snapshot a75f642c-cfa5-47a8-ba23-5001a4b7ab99 of volume 7dc45282-a5a7-49d1-990e-ac126bb13aa3 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[37124b95-0200-4fd0-a0ff-531cc8b48c2f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:18 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.291s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:18 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Deleted volume successfully. Nov 03 20:22:18 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 Nov 03 20:22:18 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-611fab2b-bd7a-4a1b-9157-a76a2e2663de tempest-VolumesTransfersV355Test-1465283354 None] Lock "cinder-c988982c-d572-4434-9000-a749a9bab40e-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:19 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3" returned: 0 in 0.505s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:19 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 1G Nov 03 20:22:19 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Flow 'volume_create_manager' (af640ae8-2a3c-4918-bed0-e42c7166b0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f018eb1-2734-4f85-ab6d-bf4b5237969c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f018eb1-2734-4f85-ab6d-bf4b5237969c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-431143955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13de2b29-3ac1-4804-9a61-4504c0e5d515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89689232e5274d13ad3e801d9d1d2b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:19Z,use_quota=True,user_id='035e1fdbb5334e3fa86ecd15cf75daa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212ca12e-f382-48a5-a0c8-23181134b9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212ca12e-f382-48a5-a0c8-23181134b9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dae5d36-49dd-4c76-9180-4b1712c2a5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dae5d36-49dd-4c76-9180-4b1712c2a5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13de2b29-3ac1-4804-9a61-4504c0e5d515', 'volume_name': 'volume-13de2b29-3ac1-4804-9a61-4504c0e5d515', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719aa8ee-3697-4e43-9a92-78beae1dd364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719aa8ee-3697-4e43-9a92-78beae1dd364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fb4e48-e6c6-499d-8145-289ff3a7b3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:19 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Volume 13de2b29-3ac1-4804-9a61-4504c0e5d515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13de2b29-3ac1-4804-9a61-4504c0e5d515', 'volume_size': 1} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:19 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 1G" returned: 0 in 0.432s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:19 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 Nov 03 20:22:19 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:19 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99" returned: 0 in 0.282s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:19 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:22:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:19 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 Nov 03 20:22:19 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:20 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99" returned: 0 in 0.242s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:20 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.info Nov 03 20:22:20 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:20 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.info" returned: 0 in 0.250s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:20 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:20 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.info Nov 03 20:22:20 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:20 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.info" returned: 0 in 0.232s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-431143955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13de2b29-3ac1-4804-9a61-4504c0e5d515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89689232e5274d13ad3e801d9d1d2b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:19Z,use_quota=True,user_id='035e1fdbb5334e3fa86ecd15cf75daa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Creating volume 13de2b29-3ac1-4804-9a61-4504c0e5d515 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:20 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:22:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:20 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515 1073741824 Nov 03 20:22:20 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:20 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-6d42097f-d2d3-4abd-aec5-eaec9021ac3e tempest-GroupSnapshotsV319Test-2099816977 None] group_snapshot 2418727d-8c65-44c8-8968-9352637099ad: created successfully Nov 03 20:22:21 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515 1073741824" returned: 0 in 0.397s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:21 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515 Nov 03 20:22:21 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:21 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515" returned: 0 in 0.243s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fb4e48-e6c6-499d-8145-289ff3a7b3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13de2b29-3ac1-4804-9a61-4504c0e5d515', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418ef6ea-f3c5-4a4a-a2fa-79ed4fddd7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:21 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Volume volume-13de2b29-3ac1-4804-9a61-4504c0e5d515 (13de2b29-3ac1-4804-9a61-4504c0e5d515): created successfully Nov 03 20:22:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418ef6ea-f3c5-4a4a-a2fa-79ed4fddd7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Flow 'volume_create_manager' (af640ae8-2a3c-4918-bed0-e42c7166b0f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:21 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-479b98f0-808a-4231-9743-094c0f0fe90c tempest-VolumesTransfersV355Test-1589320684 None] Created volume successfully. Nov 03 20:22:22 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] group_snapshot 2418727d-8c65-44c8-8968-9352637099ad: deleting Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] group_snapshot 2418727d-8c65-44c8-8968-9352637099ad: deleting {{(pid=87342) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Acquiring lock "cinder-quobyte-7dc45282-a5a7-49d1-990e-ac126bb13aa3" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Lock "cinder-quobyte-7dc45282-a5a7-49d1-990e-ac126bb13aa3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Acquiring lock "cinder-quobyte-a75f642c-cfa5-47a8-ba23-5001a4b7ab99" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Lock "cinder-quobyte-a75f642c-cfa5-47a8-ba23-5001a4b7ab99" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Deleting offline snapshot a75f642c-cfa5-47a8-ba23-5001a4b7ab99 of volume 7dc45282-a5a7-49d1-990e-ac126bb13aa3 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] snapshot_file for this snap is: volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefa3d90-643f-4e83-8bd4-58d1256ac869]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:22 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 Nov 03 20:22:22 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:22 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99" returned: 0 in 0.431s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af623d6-1217-4868-8822-c2efc1bee7b2]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Acquiring lock "cinder-13de2b29-3ac1-4804-9a61-4504c0e5d515-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Lock "cinder-13de2b29-3ac1-4804-9a61-4504c0e5d515-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:22 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 Nov 03 20:22:22 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Acquiring lock "cinder-quobyte-13de2b29-3ac1-4804-9a61-4504c0e5d515" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Lock "cinder-quobyte-13de2b29-3ac1-4804-9a61-4504c0e5d515" acquired by "delete_volume" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3e17bb-b2cd-4aff-8462-39b1ae12e776]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:22 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515 Nov 03 20:22:22 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:23 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3" returned: 0 in 0.384s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:23 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 Nov 03 20:22:23 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:23 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515" returned: 0 in 0.354s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:23 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515 Nov 03 20:22:23 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:23 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99" returned: 0 in 0.361s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:23 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99 Nov 03 20:22:23 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:23 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-13de2b29-3ac1-4804-9a61-4504c0e5d515" returned: 0 in 0.272s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Lock "cinder-quobyte-13de2b29-3ac1-4804-9a61-4504c0e5d515" released by "delete_volume" :: held 0.671s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Created reservations ['19b2b5f1-e714-4cbf-b911-e464044b4f36', 'fd5d7a36-6b12-418f-b4a2-67d9540222d8', '02f24dea-124c-4f02-bc99-542012917ff6', '60887fff-7dd2-4756-9661-3ca16c74ca82'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:23 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:23 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:23 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:23 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:23 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3.a75f642c-cfa5-47a8-ba23-5001a4b7ab99" returned: 0 in 0.258s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Lock "cinder-quobyte-a75f642c-cfa5-47a8-ba23-5001a4b7ab99" released by "_delete_snapshot" :: held 1.561s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Lock "cinder-quobyte-7dc45282-a5a7-49d1-990e-ac126bb13aa3" released by "delete_snapshot" :: held 1.590s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=166,cinder:UPDATE=181,cinder:INSERT=39,cinder:DELETE=6 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:22:23 devstack cinder-volume[87342]: WARNING cinder.quota [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-89484408 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-89484408, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:22:23 devstack cinder-volume[87342]: WARNING cinder.quota [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-89484408 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-89484408, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] Created reservations ['0a5a4bb4-c0f8-430e-8313-3fbbe60e5467', '5902aca2-fa56-42fb-9793-2a579715f03e', '95aee453-2b88-4999-8243-97aeda163610', '4a7166a8-f848-4699-973b-6ea035ca3967'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:23 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.314s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 8 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:22:23 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.300s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:23 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-edebe045-34ab-4c9d-80fa-37fac4d9158f tempest-GroupSnapshotsV319Test-2099816977 None] group_snapshot 2418727d-8c65-44c8-8968-9352637099ad: deleted successfully Nov 03 20:22:23 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Deleted volume successfully. Nov 03 20:22:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-001223c1-b21d-4386-a1c5-7dc6d04cf8ee tempest-VolumesTransfersV355Test-1465283354 None] Lock "cinder-13de2b29-3ac1-4804-9a61-4504c0e5d515-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:24 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=163,cinder:INSERT=48,cinder:UPDATE=191,cinder:DELETE=13 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:22:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Acquiring lock "cinder-quobyte-7dc45282-a5a7-49d1-990e-ac126bb13aa3" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Lock "cinder-quobyte-7dc45282-a5a7-49d1-990e-ac126bb13aa3" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:24 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff7fc72-2164-4d08-ac3a-3a3bb00f47a9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:24 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 Nov 03 20:22:24 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:25 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3" returned: 0 in 0.394s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:25 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3 Nov 03 20:22:25 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:25 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-7dc45282-a5a7-49d1-990e-ac126bb13aa3" returned: 0 in 0.249s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Lock "cinder-quobyte-7dc45282-a5a7-49d1-990e-ac126bb13aa3" released by "delete_volume" :: held 0.710s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Created reservations ['c5abeddd-098f-49f1-bacc-ef9510cf9ddc'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:25 devstack cinder-volume[87342]: WARNING cinder.quota [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-89484408 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-89484408, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Created reservations ['a6a51c15-11d8-488f-82ac-6545cca2d225', 'b740bb12-9fea-43de-a723-11e74178cae1', 'dfb22111-a318-4ed9-8d30-0a682240d295', '86224438-83a9-47c2-b409-45cedd34d069'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:25 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:25 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:25 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.269s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:25 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a30353b9-163d-4d29-92e1-9712a67f8898 tempest-GroupSnapshotsV319Test-2099816977 None] Delete group completed successfully. Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Flow 'volume_create_manager' (f4ae780c-29a4-4a59-9300-3bfecf934fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654785e2-5890-4d6c-a456-c05edd1bb53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654785e2-5890-4d6c-a456-c05edd1bb53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-676119521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101b4344-450a-4998-8327-c1b1cd004e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6c7918ac334e40a2eae3f469341788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:30Z,use_quota=True,user_id='1a4c9855efb04997a53c94c4566152d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d845abec-02c9-404c-bb1f-07ee2590c934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d845abec-02c9-404c-bb1f-07ee2590c934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245618a6-4daf-4070-8c00-683d82a2060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245618a6-4daf-4070-8c00-683d82a2060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101b4344-450a-4998-8327-c1b1cd004e17', 'volume_name': 'volume-101b4344-450a-4998-8327-c1b1cd004e17', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a345e77b-fd38-4fa9-af89-4fe511adc08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a345e77b-fd38-4fa9-af89-4fe511adc08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce378847-95a5-44f0-aafb-b4b2d74c4910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:30 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Volume 101b4344-450a-4998-8327-c1b1cd004e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101b4344-450a-4998-8327-c1b1cd004e17', 'volume_size': 1} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-676119521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101b4344-450a-4998-8327-c1b1cd004e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6c7918ac334e40a2eae3f469341788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:30Z,use_quota=True,user_id='1a4c9855efb04997a53c94c4566152d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Creating volume 101b4344-450a-4998-8327-c1b1cd004e17 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:30 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:30 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17 1073741824 Nov 03 20:22:30 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:30 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17 1073741824" returned: 0 in 0.511s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:30 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17 Nov 03 20:22:30 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:31 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17" returned: 0 in 0.296s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce378847-95a5-44f0-aafb-b4b2d74c4910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101b4344-450a-4998-8327-c1b1cd004e17', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c637704c-2981-4ebe-8a3b-89f4e8e163ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:31 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Volume volume-101b4344-450a-4998-8327-c1b1cd004e17 (101b4344-450a-4998-8327-c1b1cd004e17): created successfully Nov 03 20:22:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c637704c-2981-4ebe-8a3b-89f4e8e163ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Flow 'volume_create_manager' (f4ae780c-29a4-4a59-9300-3bfecf934fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:31 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2b4bfd29-c79b-4418-9908-b932873f1dea tempest-AttachVolumeTestJSON-1745915254 None] Created volume successfully. Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Flow 'volume_create_manager' (a09d72cf-c916-4e2f-b43d-3c61b98af31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d057c0-7869-448c-9b5d-e7b968ef8e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d057c0-7869-448c-9b5d-e7b968ef8e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1204430695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5def46a3b06943a99b42965014eccdea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:33Z,use_quota=True,user_id='1284ab37fe1f4e639c814c90693ed099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4d5a61-e7f3-4600-bf50-62ba8be8d0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4d5a61-e7f3-4600-bf50-62ba8be8d0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b875146-5e58-4417-8ced-1c9a4475546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b875146-5e58-4417-8ced-1c9a4475546b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf', 'volume_name': 'volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78773463-14a6-4e0c-9cdf-dbc1671698d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78773463-14a6-4e0c-9cdf-dbc1671698d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97756f6-e5c3-4de4-8b50-7a1b8f3c6511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:32 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Volume e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf', 'volume_size': 1} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1204430695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5def46a3b06943a99b42965014eccdea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:33Z,use_quota=True,user_id='1284ab37fe1f4e639c814c90693ed099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Creating volume e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:32 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:22:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:32 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf 1073741824 Nov 03 20:22:32 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:33 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf 1073741824" returned: 0 in 0.562s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:33 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf Nov 03 20:22:33 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:33 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf" returned: 0 in 0.341s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97756f6-e5c3-4de4-8b50-7a1b8f3c6511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a8d5cd-98f9-4433-9161-030216600146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:33 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Volume volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf (e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf): created successfully Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a8d5cd-98f9-4433-9161-030216600146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Flow 'volume_create_manager' (a09d72cf-c916-4e2f-b43d-3c61b98af31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:33 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-896ba899-8e96-4956-b309-d41696eb90c5 tempest-VolumesTransfersV357Test-378026067 None] Created volume successfully. Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-07e4806c-1638-45c1-89d8-332b53e2167b req-2051b123-ae08-4327-941a-ff0bd7ad90c6 tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-07e4806c-1638-45c1-89d8-332b53e2167b req-2051b123-ae08-4327-941a-ff0bd7ad90c6 tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-07e4806c-1638-45c1-89d8-332b53e2167b req-2051b123-ae08-4327-941a-ff0bd7ad90c6 tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-07e4806c-1638-45c1-89d8-332b53e2167b req-2051b123-ae08-4327-941a-ff0bd7ad90c6 tempest-AttachVolumeTestJSON-1745915254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-101b4344-450a-4998-8327-c1b1cd004e17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3726cc4c-f7d6-4402-8126-12ad83772cdc', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:22:33 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-07e4806c-1638-45c1-89d8-332b53e2167b req-2051b123-ae08-4327-941a-ff0bd7ad90c6 tempest-AttachVolumeTestJSON-1745915254 None] attachment_update completed successfully. Nov 03 20:22:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-cad4734d-1675-4d8d-9474-7afd389176d7 tempest-VolumesTransfersV357Test-2024226344 None] Transfer volume completed successfully. Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Flow 'volume_create_manager' (3da2c7e9-5cbd-49cc-bcb0-4c9b4e5dd6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6778afda-18fa-4dd8-81f6-9f3870ed8c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6778afda-18fa-4dd8-81f6-9f3870ed8c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-69007760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bb2388-102d-4e33-a1d7-91b0e6a79ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6c7918ac334e40a2eae3f469341788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:36Z,use_quota=True,user_id='1a4c9855efb04997a53c94c4566152d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7197e30-6434-4b15-b404-ad68a081acc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7197e30-6434-4b15-b404-ad68a081acc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5514fccb-5f6b-4c3f-ba91-a8dd35baee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5514fccb-5f6b-4c3f-ba91-a8dd35baee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25bb2388-102d-4e33-a1d7-91b0e6a79ce2', 'volume_name': 'volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746b0a45-4207-4a3e-a2a2-0c1511113fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746b0a45-4207-4a3e-a2a2-0c1511113fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad006dd-9b66-47b8-bef4-e3d463e23609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Volume 25bb2388-102d-4e33-a1d7-91b0e6a79ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2', 'volume_size': 1} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-69007760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bb2388-102d-4e33-a1d7-91b0e6a79ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6c7918ac334e40a2eae3f469341788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:36Z,use_quota=True,user_id='1a4c9855efb04997a53c94c4566152d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Creating volume 25bb2388-102d-4e33-a1d7-91b0e6a79ce2 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:36 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:36 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2 1073741824 Nov 03 20:22:36 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Acquiring lock "cinder-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Lock "cinder-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Acquiring lock "cinder-quobyte-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Lock "cinder-quobyte-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ae24be-34a5-40ef-b380-58fc14b40aba]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:36 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf Nov 03 20:22:36 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:36 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2 1073741824" returned: 0 in 0.522s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:37 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2 Nov 03 20:22:37 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:37 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf" returned: 0 in 0.438s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:37 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf Nov 03 20:22:37 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:37 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2" returned: 0 in 0.307s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad006dd-9b66-47b8-bef4-e3d463e23609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdba1c4-ad64-4888-9be9-287ed27dd8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:37 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Volume volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2 (25bb2388-102d-4e33-a1d7-91b0e6a79ce2): created successfully Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdba1c4-ad64-4888-9be9-287ed27dd8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Flow 'volume_create_manager' (3da2c7e9-5cbd-49cc-bcb0-4c9b4e5dd6ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4275232b-dec8-4e13-88d8-a6cbfa70b27c tempest-AttachVolumeTestJSON-1745915254 None] Created volume successfully. Nov 03 20:22:37 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf" returned: 0 in 0.263s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Lock "cinder-quobyte-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf" released by "delete_volume" :: held 0.756s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Created reservations ['2a9b4957-a562-4919-aec2-861cfce17575', '8df89b05-7b65-48f0-8674-f8036df63135', 'e522fd8d-acff-4e2f-8a4c-23b8d7dfc6ac', '76def6dc-07c1-4b64-8b1f-b11f63b0b7f4'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:37 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:37 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:37 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.258s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Deleted volume successfully. Nov 03 20:22:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12db117c-6456-400a-b08e-5152dc8e0f8a tempest-VolumesTransfersV357Test-1644097567 None] Lock "cinder-e8395aa6-e1c2-4a0b-94e8-a9e8e31266bf-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Flow 'volume_create_manager' (77c905df-f0f8-46a3-8ebe-093c128b4689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc53a16c-cdc5-4cc5-986e-86df589bd18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc53a16c-cdc5-4cc5-986e-86df589bd18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-438542407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb308ef6-e0f7-483c-b1a8-210a14d361ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5def46a3b06943a99b42965014eccdea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:38Z,use_quota=True,user_id='1284ab37fe1f4e639c814c90693ed099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f987ca-1ea8-4f9f-853b-3d3ffffabec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f987ca-1ea8-4f9f-853b-3d3ffffabec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e055287-2917-46ba-8a76-9a17bd337165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e055287-2917-46ba-8a76-9a17bd337165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb308ef6-e0f7-483c-b1a8-210a14d361ed', 'volume_name': 'volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4a5d36-73cf-4e1c-a6ae-47da5c7fa7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4a5d36-73cf-4e1c-a6ae-47da5c7fa7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80bbac41-6db0-4d54-881e-6022993b7149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:38 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Volume fb308ef6-e0f7-483c-b1a8-210a14d361ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed', 'volume_size': 1} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-438542407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb308ef6-e0f7-483c-b1a8-210a14d361ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5def46a3b06943a99b42965014eccdea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:38Z,use_quota=True,user_id='1284ab37fe1f4e639c814c90693ed099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Creating volume fb308ef6-e0f7-483c-b1a8-210a14d361ed {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:38 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:38 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed 1073741824 Nov 03 20:22:38 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:38 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed 1073741824" returned: 0 in 0.554s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:39 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed Nov 03 20:22:39 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:39 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed" returned: 0 in 0.276s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80bbac41-6db0-4d54-881e-6022993b7149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0eca051-74f1-4ce0-bc8c-4b5451586b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:39 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Volume volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed (fb308ef6-e0f7-483c-b1a8-210a14d361ed): created successfully Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0eca051-74f1-4ce0-bc8c-4b5451586b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Flow 'volume_create_manager' (77c905df-f0f8-46a3-8ebe-093c128b4689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-72bcc00a-ddc7-475a-a088-8585be37b22f tempest-VolumesTransfersV357Test-378026067 None] Created volume successfully. Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-ae9eadb1-aabc-442c-ae1d-5dd27feff0e9 req-95e48f8e-dd12-4b0d-83d2-5f556e19893a tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-ae9eadb1-aabc-442c-ae1d-5dd27feff0e9 req-95e48f8e-dd12-4b0d-83d2-5f556e19893a tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-ae9eadb1-aabc-442c-ae1d-5dd27feff0e9 req-95e48f8e-dd12-4b0d-83d2-5f556e19893a tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Flow 'volume_create_manager' (b2b21860-d39f-4205-9609-2d13ebb29668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6b54a4-3ad6-4b88-ad3c-bea77f4deaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-ae9eadb1-aabc-442c-ae1d-5dd27feff0e9 req-95e48f8e-dd12-4b0d-83d2-5f556e19893a tempest-AttachVolumeTestJSON-1745915254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55f86559-b1ec-4914-8634-1cd7059810ba', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6b54a4-3ad6-4b88-ad3c-bea77f4deaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-548329606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24b3335-1adb-45e7-9af2-a7d376d93bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3010d319024688bda4e906da543e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:39Z,use_quota=True,user_id='6768bcd1050847b2ba3301e484a1ae39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2aa0bef-5e97-4d25-9e81-35269de062d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2aa0bef-5e97-4d25-9e81-35269de062d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccea2fb-176b-4b69-8954-9e95c17e48bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccea2fb-176b-4b69-8954-9e95c17e48bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24b3335-1adb-45e7-9af2-a7d376d93bf0', 'volume_name': 'volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaadf81a-2405-40b4-aad8-d0fd6151eda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaadf81a-2405-40b4-aad8-d0fd6151eda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f17169-4888-44b2-bb90-e5c47b9898cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:39 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Volume b24b3335-1adb-45e7-9af2-a7d376d93bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0', 'volume_size': 1} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-548329606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24b3335-1adb-45e7-9af2-a7d376d93bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3010d319024688bda4e906da543e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:39Z,use_quota=True,user_id='6768bcd1050847b2ba3301e484a1ae39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Creating volume b24b3335-1adb-45e7-9af2-a7d376d93bf0 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:39 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:39 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0 1073741824 Nov 03 20:22:39 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-ae9eadb1-aabc-442c-ae1d-5dd27feff0e9 req-95e48f8e-dd12-4b0d-83d2-5f556e19893a tempest-AttachVolumeTestJSON-1745915254 None] attachment_update completed successfully. Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Acquiring lock "cinder-fb308ef6-e0f7-483c-b1a8-210a14d361ed-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Lock "cinder-fb308ef6-e0f7-483c-b1a8-210a14d361ed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Acquiring lock "cinder-quobyte-fb308ef6-e0f7-483c-b1a8-210a14d361ed" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Lock "cinder-quobyte-fb308ef6-e0f7-483c-b1a8-210a14d361ed" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc907f8a-112d-40b1-8dde-6efb5cc5940e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:40 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed Nov 03 20:22:40 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:40 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0 1073741824" returned: 0 in 0.592s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:40 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0 Nov 03 20:22:40 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:40 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed" returned: 0 in 0.478s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:40 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed Nov 03 20:22:40 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:40 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0" returned: 0 in 0.288s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f17169-4888-44b2-bb90-e5c47b9898cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070bdd2d-7a05-48cf-adc9-eab4e39ae32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:40 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Volume volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0 (b24b3335-1adb-45e7-9af2-a7d376d93bf0): created successfully Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070bdd2d-7a05-48cf-adc9-eab4e39ae32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Flow 'volume_create_manager' (b2b21860-d39f-4205-9609-2d13ebb29668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8ca37807-ff43-47a3-8e04-75d9b5d7837c tempest-VolumeQuotasNegativeTestJSON-357761488 None] Created volume successfully. Nov 03 20:22:40 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fb308ef6-e0f7-483c-b1a8-210a14d361ed" returned: 0 in 0.270s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Lock "cinder-quobyte-fb308ef6-e0f7-483c-b1a8-210a14d361ed" released by "delete_volume" :: held 0.792s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Created reservations ['b0bb3fb9-d72f-4171-982b-73d33fe39b19', '1c5397d5-dace-41e0-9630-92814e95e183', '657a60d7-25d1-4190-862b-43fc55796554', '85408097-0afb-4c92-add3-88680276307d'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:40 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:40 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:41 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.245s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:41 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:41 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Deleted volume successfully. Nov 03 20:22:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3bcb3bfb-720e-49a8-b166-db6018573bf9 tempest-VolumesTransfersV357Test-1644097567 None] Lock "cinder-fb308ef6-e0f7-483c-b1a8-210a14d361ed-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-eb6e7c99-a12b-4345-bfd7-0093b7350886 req-f728130f-4923-458b-88db-773fd83d4edc tempest-AttachVolumeTestJSON-1745915254 None] Terminate volume connection completed successfully. Nov 03 20:22:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-eb6e7c99-a12b-4345-bfd7-0093b7350886 req-f728130f-4923-458b-88db-773fd83d4edc tempest-AttachVolumeTestJSON-1745915254 None] Deleting attachment 3726cc4c-f7d6-4402-8126-12ad83772cdc. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:22:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Acquiring lock "cinder-b24b3335-1adb-45e7-9af2-a7d376d93bf0-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Lock "cinder-b24b3335-1adb-45e7-9af2-a7d376d93bf0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Acquiring lock "cinder-quobyte-b24b3335-1adb-45e7-9af2-a7d376d93bf0" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Lock "cinder-quobyte-b24b3335-1adb-45e7-9af2-a7d376d93bf0" acquired by "delete_volume" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:43 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7610925a-3a31-4148-af71-191be47b7a43]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:43 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0 Nov 03 20:22:43 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:43 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-38a150f6-108e-41b9-af74-166cf0205da9 req-60786f40-9d79-495f-a12f-e0cb17958c0d tempest-AttachVolumeTestJSON-1745915254 None] Terminate volume connection completed successfully. Nov 03 20:22:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-38a150f6-108e-41b9-af74-166cf0205da9 req-60786f40-9d79-495f-a12f-e0cb17958c0d tempest-AttachVolumeTestJSON-1745915254 None] Deleting attachment 55f86559-b1ec-4914-8634-1cd7059810ba. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:22:43 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0" returned: 0 in 0.533s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:43 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0 Nov 03 20:22:43 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:44 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b24b3335-1adb-45e7-9af2-a7d376d93bf0" returned: 0 in 0.312s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Lock "cinder-quobyte-b24b3335-1adb-45e7-9af2-a7d376d93bf0" released by "delete_volume" :: held 0.910s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Created reservations ['16d7eacd-9c22-44f6-84ab-7d4b3cad7925', '0efdfc8c-6992-4462-b477-3d88b35dba67', 'bc2868da-80fd-43a1-92b1-0afb58b3e8a6', '51a3e27f-8764-47e5-a7a2-ff09282af6b6'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:44 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:44 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:44 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.309s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Deleted volume successfully. Nov 03 20:22:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7883d1c7-16d2-4b55-855c-47587bceef09 tempest-VolumeQuotasNegativeTestJSON-357761488 None] Lock "cinder-b24b3335-1adb-45e7-9af2-a7d376d93bf0-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "cinder-25bb2388-102d-4e33-a1d7-91b0e6a79ce2-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-25bb2388-102d-4e33-a1d7-91b0e6a79ce2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "cinder-quobyte-25bb2388-102d-4e33-a1d7-91b0e6a79ce2" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-quobyte-25bb2388-102d-4e33-a1d7-91b0e6a79ce2" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:50 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e00d5f-da08-4b5d-ae1b-538bc67e0372]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:50 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2 Nov 03 20:22:50 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:50 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2" returned: 0 in 0.455s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:50 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2 Nov 03 20:22:50 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:50 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25bb2388-102d-4e33-a1d7-91b0e6a79ce2" returned: 0 in 0.271s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-quobyte-25bb2388-102d-4e33-a1d7-91b0e6a79ce2" released by "delete_volume" :: held 0.783s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:50 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Created reservations ['a511f5b6-ea7b-4aa1-b9eb-41484f8e1461', '551b9640-26e1-456f-ac39-1f57431202c3', 'e0c2436e-d466-4023-8b5e-ba042b582cec', '36c95187-c67b-4fbc-8f9e-1138119e1c31'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:51 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:51 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "cinder-101b4344-450a-4998-8327-c1b1cd004e17-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:51 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.275s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-101b4344-450a-4998-8327-c1b1cd004e17-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Deleted volume successfully. Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "cinder-quobyte-101b4344-450a-4998-8327-c1b1cd004e17" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-537677fb-f2ef-44df-9186-cfccb802fa23 tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-25bb2388-102d-4e33-a1d7-91b0e6a79ce2-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-quobyte-101b4344-450a-4998-8327-c1b1cd004e17" acquired by "delete_volume" :: waited 0.045s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f205f8a9-a5a5-4827-bdcf-75bb76d688f4]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:51 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17 Nov 03 20:22:51 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:51 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17" returned: 0 in 0.419s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:51 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17 Nov 03 20:22:51 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:52 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-101b4344-450a-4998-8327-c1b1cd004e17" returned: 0 in 0.274s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-quobyte-101b4344-450a-4998-8327-c1b1cd004e17" released by "delete_volume" :: held 0.757s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Created reservations ['5f8fc46e-8175-4fa1-9f12-58020146e715', 'fb78bd26-6b52-44b3-a184-5b174c310c0b', '24528dae-4c92-4e7b-ae41-67ee87620a85', '530a9f3b-0642-4672-a4a0-775ab3ecf6f2'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:52 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:52 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:52 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.367s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "cinder-861fab4d-b3bd-43f4-b63e-631c2942c4f5-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:52 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Deleted volume successfully. Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-36e5b057-3ac8-484a-b4c8-384cee96441a tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-101b4344-450a-4998-8327-c1b1cd004e17-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-861fab4d-b3bd-43f4-b63e-631c2942c4f5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Flow 'volume_create_manager' (49bb01ce-9b48-4038-82ea-1b093cdfc89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53545efe-898a-4ecb-9ba5-94205d5d076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "cinder-quobyte-861fab4d-b3bd-43f4-b63e-631c2942c4f5" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53545efe-898a-4ecb-9ba5-94205d5d076c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1006878347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317df687-7bdc-443c-9953-41e9846e30ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6b4376fc0a4c7cac1d287e2ae46ba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:53Z,use_quota=True,user_id='5bbebe413a754cbda5c4903718708a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0f2b12-f89f-4bd6-a0cf-da294b6bb230),volume_type_id=9b0f2b12-f89f-4bd6-a0cf-da294b6bb230)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30cb5c7b-445a-4932-a608-24b77cbab616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30cb5c7b-445a-4932-a608-24b77cbab616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d593ed0-c3a2-4717-80e6-ef33ff3caab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d593ed0-c3a2-4717-80e6-ef33ff3caab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317df687-7bdc-443c-9953-41e9846e30ea', 'volume_name': 'volume-317df687-7bdc-443c-9953-41e9846e30ea', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b0f052-d8e1-4f21-9e22-89983e46fce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b0f052-d8e1-4f21-9e22-89983e46fce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d949b9-7237-48c1-9f2d-2cb46b0313d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:52 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Volume 317df687-7bdc-443c-9953-41e9846e30ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317df687-7bdc-443c-9953-41e9846e30ea', 'volume_size': 1} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1006878347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317df687-7bdc-443c-9953-41e9846e30ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6b4376fc0a4c7cac1d287e2ae46ba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:53Z,use_quota=True,user_id='5bbebe413a754cbda5c4903718708a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0f2b12-f89f-4bd6-a0cf-da294b6bb230),volume_type_id=9b0f2b12-f89f-4bd6-a0cf-da294b6bb230)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Creating volume 317df687-7bdc-443c-9953-41e9846e30ea {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:52 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-quobyte-861fab4d-b3bd-43f4-b63e-631c2942c4f5" acquired by "delete_volume" :: waited 0.078s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:52 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea 1073741824 Nov 03 20:22:52 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4786e53-1141-46ab-b7d6-17d14c71191c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:53 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5 Nov 03 20:22:53 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:53 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5" returned: 0 in 0.393s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:53 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5 Nov 03 20:22:53 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:53 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea 1073741824" returned: 0 in 0.521s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:53 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea Nov 03 20:22:53 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:53 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-861fab4d-b3bd-43f4-b63e-631c2942c4f5" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-quobyte-861fab4d-b3bd-43f4-b63e-631c2942c4f5" released by "delete_volume" :: held 0.714s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Created reservations ['d7c46d01-2eec-48e4-a71c-b757e76b63df', 'e03aa512-c13f-432f-bd7d-23b321953437', 'db21ce14-16c4-4b0b-ae4e-105c27695022', '94debbd3-0cdf-4055-b6f4-0c4c432dd0ae'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:53 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea" returned: 0 in 0.312s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d949b9-7237-48c1-9f2d-2cb46b0313d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317df687-7bdc-443c-9953-41e9846e30ea', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24faa5c-f7fd-4012-898f-d4e6e64c5ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:53 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Volume volume-317df687-7bdc-443c-9953-41e9846e30ea (317df687-7bdc-443c-9953-41e9846e30ea): created successfully Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24faa5c-f7fd-4012-898f-d4e6e64c5ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Flow 'volume_create_manager' (49bb01ce-9b48-4038-82ea-1b093cdfc89d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:53 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5ce02dfd-ba09-4de4-bfd0-b1870bffc4e6 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Created volume successfully. Nov 03 20:22:53 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:53 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:54 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.324s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:54 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:54 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Deleted volume successfully. Nov 03 20:22:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-04829da2-a426-4c02-b9dc-33b59ddb57eb tempest-AttachVolumeTestJSON-1745915254 None] Lock "cinder-861fab4d-b3bd-43f4-b63e-631c2942c4f5-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9e516ed8-3230-4eef-bd86-723372c440c7 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9e516ed8-3230-4eef-bd86-723372c440c7 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9e516ed8-3230-4eef-bd86-723372c440c7 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9e516ed8-3230-4eef-bd86-723372c440c7 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9e516ed8-3230-4eef-bd86-723372c440c7 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e516ed8-3230-4eef-bd86-723372c440c7 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:55 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:55 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:55 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e516ed8-3230-4eef-bd86-723372c440c7 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.304s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:55 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-9e516ed8-3230-4eef-bd86-723372c440c7 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:55 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-9e516ed8-3230-4eef-bd86-723372c440c7 tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Retype volume completed successfully. Nov 03 20:22:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Acquiring lock "cinder-317df687-7bdc-443c-9953-41e9846e30ea-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "cinder-317df687-7bdc-443c-9953-41e9846e30ea-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Acquiring lock "cinder-quobyte-317df687-7bdc-443c-9953-41e9846e30ea" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "cinder-quobyte-317df687-7bdc-443c-9953-41e9846e30ea" acquired by "delete_volume" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:56 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe065b82-a9d9-404f-b6de-f486c464cd95]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:56 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea Nov 03 20:22:56 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:57 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea" returned: 0 in 0.445s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:57 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea Nov 03 20:22:57 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:57 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-317df687-7bdc-443c-9953-41e9846e30ea" returned: 0 in 0.364s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "cinder-quobyte-317df687-7bdc-443c-9953-41e9846e30ea" released by "delete_volume" :: held 0.872s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:57 devstack cinder-volume[87342]: WARNING cinder.quota [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:22:57 devstack cinder-volume[87342]: WARNING cinder.quota [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:22:57 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Created reservations ['3c202fa4-5857-4825-a015-967a55a19f6e', 'a18c844c-71a0-4f02-b2a8-78e0144ad1a1', '0c0cd023-3514-4387-95c7-4b92ecdf8562', 'eba4bd4e-ee74-49d1-a7ce-a021b9d2b6fc'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:57 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:22:57 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:58 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.491s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:58 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:58 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Deleted volume successfully. Nov 03 20:22:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-792d6cca-b453-4fe8-8cc1-11a9c3f9521d tempest-VolumeRetypeWithoutMigrationTest-517407321 None] Lock "cinder-317df687-7bdc-443c-9953-41e9846e30ea-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Flow 'volume_create_manager' (f29626d4-7039-493c-8b98-6558a56424d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c78ea12-3742-4886-8406-f600ece02597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c78ea12-3742-4886-8406-f600ece02597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1649068999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9969d3a1-d353-4145-bc22-2b354f44e6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e729cb42d40a4c7d9c33fb7fd282b980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:00Z,use_quota=True,user_id='96ac18e95f8042d68554a0fecec184b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a555b98b-3a4b-4f21-a1e2-d95bf3ee763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a555b98b-3a4b-4f21-a1e2-d95bf3ee763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde1a540-0a63-4224-bd69-2f3e9a3b4fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde1a540-0a63-4224-bd69-2f3e9a3b4fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9969d3a1-d353-4145-bc22-2b354f44e6f1', 'volume_name': 'volume-9969d3a1-d353-4145-bc22-2b354f44e6f1', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02fafab-bb5b-46c6-8aa6-02a4205cec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02fafab-bb5b-46c6-8aa6-02a4205cec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ebb033-b948-45ad-9c8d-9346701a0ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:59 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Volume 9969d3a1-d353-4145-bc22-2b354f44e6f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9969d3a1-d353-4145-bc22-2b354f44e6f1', 'volume_size': 1} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1649068999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9969d3a1-d353-4145-bc22-2b354f44e6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e729cb42d40a4c7d9c33fb7fd282b980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:00Z,use_quota=True,user_id='96ac18e95f8042d68554a0fecec184b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Creating volume 9969d3a1-d353-4145-bc22-2b354f44e6f1 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:59 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:22:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:59 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 1073741824 Nov 03 20:22:59 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:00 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 1073741824" returned: 0 in 0.660s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:00 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 Nov 03 20:23:00 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:00 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1" returned: 0 in 0.271s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ebb033-b948-45ad-9c8d-9346701a0ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9969d3a1-d353-4145-bc22-2b354f44e6f1', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eac56e6-d833-4b90-9d06-08bd83dad73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:00 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Volume volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 (9969d3a1-d353-4145-bc22-2b354f44e6f1): created successfully Nov 03 20:23:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eac56e6-d833-4b90-9d06-08bd83dad73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Flow 'volume_create_manager' (f29626d4-7039-493c-8b98-6558a56424d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:00 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-433eac85-79f1-489c-9e85-085ea11236bd tempest-VolumesActionsTest-914127801 None] Created volume successfully. Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Flow 'volume_create_manager' (46503c66-2174-44fe-8237-2a68875f1f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ded732-158f-4016-91e0-6555301fc2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ded732-158f-4016-91e0-6555301fc2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-247694185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b010f75b143342de9f8d56fe6efd4651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:06Z,use_quota=True,user_id='9ceea87a12604114a8a78f9544643ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603b20a5-2d9c-40c8-8d88-a99415830302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603b20a5-2d9c-40c8-8d88-a99415830302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c1e794-4864-41f8-b6f5-d082ba14be18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c1e794-4864-41f8-b6f5-d082ba14be18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f', 'volume_name': 'volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22645053-91d1-40cd-8d0c-989b6aff2ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22645053-91d1-40cd-8d0c-989b6aff2ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f541379-2aeb-44a5-889c-f3dd79ac00e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:06 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Volume ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f', 'volume_size': 1} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-247694185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b010f75b143342de9f8d56fe6efd4651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:06Z,use_quota=True,user_id='9ceea87a12604114a8a78f9544643ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Creating volume ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:06 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:06 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f 1073741824 Nov 03 20:23:06 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:06 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f 1073741824" returned: 0 in 0.566s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:06 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f Nov 03 20:23:06 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:07 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f" returned: 0 in 0.289s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f541379-2aeb-44a5-889c-f3dd79ac00e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639849e2-5bfb-4b13-a148-db9924cb719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:07 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Volume volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f (ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f): created successfully Nov 03 20:23:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639849e2-5bfb-4b13-a148-db9924cb719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Flow 'volume_create_manager' (46503c66-2174-44fe-8237-2a68875f1f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:07 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f17cf496-f64a-453a-b4ed-c8086a604113 tempest-VolumesTestJSON-26395585 None] Created volume successfully. Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Flow 'volume_create_manager' (3c322428-23b8-400c-a4cc-0896841885eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348279d5-0c72-4f50-9648-f5cdb8785a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348279d5-0c72-4f50-9648-f5cdb8785a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-773691764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8caf414a-d505-4d7f-b31c-c375aa53b56d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b010f75b143342de9f8d56fe6efd4651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:09Z,use_quota=True,user_id='9ceea87a12604114a8a78f9544643ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dff333a-26da-4577-b7be-4987e5a96be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dff333a-26da-4577-b7be-4987e5a96be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909198e4-dcca-437a-acb5-db2c587266ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909198e4-dcca-437a-acb5-db2c587266ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8caf414a-d505-4d7f-b31c-c375aa53b56d', 'volume_name': 'volume-8caf414a-d505-4d7f-b31c-c375aa53b56d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0358c66e-f086-4d04-bb52-e3450205a9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0358c66e-f086-4d04-bb52-e3450205a9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3473afe-e20e-4f34-b64b-798542374c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:09 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Volume 8caf414a-d505-4d7f-b31c-c375aa53b56d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8caf414a-d505-4d7f-b31c-c375aa53b56d', 'volume_size': 1} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-773691764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8caf414a-d505-4d7f-b31c-c375aa53b56d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b010f75b143342de9f8d56fe6efd4651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:09Z,use_quota=True,user_id='9ceea87a12604114a8a78f9544643ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Creating volume 8caf414a-d505-4d7f-b31c-c375aa53b56d {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:09 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:09 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d 1073741824 Nov 03 20:23:09 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:09 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-05fce69d-da97-4699-9f1a-2e9eaaf07a04 tempest-VolumesActionsTest-914127801 None] Acquiring lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1" by "attach_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d 1073741824" returned: 0 in 0.651s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-05fce69d-da97-4699-9f1a-2e9eaaf07a04 tempest-VolumesActionsTest-914127801 None] Lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1" acquired by "attach_volume" :: waited 0.050s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:10 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d Nov 03 20:23:10 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-05fce69d-da97-4699-9f1a-2e9eaaf07a04 tempest-VolumesActionsTest-914127801 None] Attaching volume 9969d3a1-d353-4145-bc22-2b354f44e6f1 to instance cf5abbde-be64-425d-adbe-b64a382af103 at mountpoint /dev/vdb on host None. Nov 03 20:23:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-05fce69d-da97-4699-9f1a-2e9eaaf07a04 tempest-VolumesActionsTest-914127801 None] Attach volume completed successfully. Nov 03 20:23:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-05fce69d-da97-4699-9f1a-2e9eaaf07a04 tempest-VolumesActionsTest-914127801 None] Lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1" released by "attach_volume" :: held 0.177s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5734045f-2dd4-4bc4-a61d-53a1d10c8524 tempest-VolumesActionsTest-914127801 None] Acquiring lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1-detach_volume" by "detach_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:10 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d" returned: 0 in 0.414s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5734045f-2dd4-4bc4-a61d-53a1d10c8524 tempest-VolumesActionsTest-914127801 None] Lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5734045f-2dd4-4bc4-a61d-53a1d10c8524 tempest-VolumesActionsTest-914127801 None] Detaching volume 9969d3a1-d353-4145-bc22-2b354f44e6f1 from instance cf5abbde-be64-425d-adbe-b64a382af103. Nov 03 20:23:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3473afe-e20e-4f34-b64b-798542374c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8caf414a-d505-4d7f-b31c-c375aa53b56d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68595aed-9888-4a88-bc7d-be040a5e4834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:10 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Volume volume-8caf414a-d505-4d7f-b31c-c375aa53b56d (8caf414a-d505-4d7f-b31c-c375aa53b56d): created successfully Nov 03 20:23:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68595aed-9888-4a88-bc7d-be040a5e4834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Flow 'volume_create_manager' (3c322428-23b8-400c-a4cc-0896841885eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ede27e57-694a-457f-b661-289955084263 tempest-VolumesTestJSON-26395585 None] Created volume successfully. Nov 03 20:23:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5734045f-2dd4-4bc4-a61d-53a1d10c8524 tempest-VolumesActionsTest-914127801 None] Detach volume completed successfully. Nov 03 20:23:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5734045f-2dd4-4bc4-a61d-53a1d10c8524 tempest-VolumesActionsTest-914127801 None] Lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:11 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Flow 'volume_create_manager' (5a0df468-511d-480c-9ca1-b794c3e1705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4356e6c-e147-4cb6-9f97-0c54c4c19c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4356e6c-e147-4cb6-9f97-0c54c4c19c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-849301068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60294eaf-fef4-4fa4-af78-0f68c88d768a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b010f75b143342de9f8d56fe6efd4651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:12Z,use_quota=True,user_id='9ceea87a12604114a8a78f9544643ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734d27a1-9f49-4759-a7c7-036aede13ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734d27a1-9f49-4759-a7c7-036aede13ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a925a5-4412-4f7c-a719-75d972f47060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a925a5-4412-4f7c-a719-75d972f47060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60294eaf-fef4-4fa4-af78-0f68c88d768a', 'volume_name': 'volume-60294eaf-fef4-4fa4-af78-0f68c88d768a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e6fe3b-6164-4918-83c0-d7b3c2516cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e6fe3b-6164-4918-83c0-d7b3c2516cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52de66f4-7af7-4487-bf8c-dcea94340414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:12 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Volume 60294eaf-fef4-4fa4-af78-0f68c88d768a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60294eaf-fef4-4fa4-af78-0f68c88d768a', 'volume_size': 1} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-849301068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60294eaf-fef4-4fa4-af78-0f68c88d768a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b010f75b143342de9f8d56fe6efd4651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:12Z,use_quota=True,user_id='9ceea87a12604114a8a78f9544643ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Creating volume 60294eaf-fef4-4fa4-af78-0f68c88d768a {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:12 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:12 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a 1073741824 Nov 03 20:23:12 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:12 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a 1073741824" returned: 0 in 0.670s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:12 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a Nov 03 20:23:12 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:13 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a" returned: 0 in 0.290s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52de66f4-7af7-4487-bf8c-dcea94340414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60294eaf-fef4-4fa4-af78-0f68c88d768a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f49cd1-1f75-4852-84ee-606e5833d4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:13 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Volume volume-60294eaf-fef4-4fa4-af78-0f68c88d768a (60294eaf-fef4-4fa4-af78-0f68c88d768a): created successfully Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f49cd1-1f75-4852-84ee-606e5833d4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Flow 'volume_create_manager' (5a0df468-511d-480c-9ca1-b794c3e1705b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:13 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7b61967b-6abd-4eec-9632-a92678fc8286 tempest-VolumesTestJSON-26395585 None] Created volume successfully. Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Flow 'volume_create_manager' (11f0ef01-5adc-49aa-a3db-ed99361af5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cbc1f8-a383-4059-be29-c31d287ba0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cbc1f8-a383-4059-be29-c31d287ba0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-689663510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91fa93b7-eb93-4b88-abd3-e93bce810126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4fb9f3d1fca4336b4f8487395ac35a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:14Z,use_quota=True,user_id='e951f6724df0441f8d7fc0008ad43f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a898dfee-def8-4e01-b53d-f13434171ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a898dfee-def8-4e01-b53d-f13434171ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac04cb8-bdd4-425a-9c25-ace70138e180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac04cb8-bdd4-425a-9c25-ace70138e180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91fa93b7-eb93-4b88-abd3-e93bce810126', 'volume_name': 'volume-91fa93b7-eb93-4b88-abd3-e93bce810126', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdbbd04-8c82-4739-8076-eb6bce1badc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdbbd04-8c82-4739-8076-eb6bce1badc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d42cfca-6f54-48a0-a7e5-65f1b26ff6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:13 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Volume 91fa93b7-eb93-4b88-abd3-e93bce810126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91fa93b7-eb93-4b88-abd3-e93bce810126', 'volume_size': 1} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-689663510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91fa93b7-eb93-4b88-abd3-e93bce810126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4fb9f3d1fca4336b4f8487395ac35a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:14Z,use_quota=True,user_id='e951f6724df0441f8d7fc0008ad43f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Creating volume 91fa93b7-eb93-4b88-abd3-e93bce810126 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:13 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:23:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:13 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 1073741824 Nov 03 20:23:13 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:14 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 1073741824" returned: 0 in 0.524s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:14 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 Nov 03 20:23:14 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:14 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126" returned: 0 in 0.363s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d42cfca-6f54-48a0-a7e5-65f1b26ff6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91fa93b7-eb93-4b88-abd3-e93bce810126', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d526933-2c8c-4c18-89f7-9605e16e854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:14 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Volume volume-91fa93b7-eb93-4b88-abd3-e93bce810126 (91fa93b7-eb93-4b88-abd3-e93bce810126): created successfully Nov 03 20:23:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d526933-2c8c-4c18-89f7-9605e16e854d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Flow 'volume_create_manager' (11f0ef01-5adc-49aa-a3db-ed99361af5f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:14 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-97bf4137-2a6c-44fd-9333-791b452ef512 tempest-SnapshotMetadataTestJSON-926737283 None] Created volume successfully. Nov 03 20:23:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Acquiring lock "cinder-60294eaf-fef4-4fa4-af78-0f68c88d768a-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Lock "cinder-60294eaf-fef4-4fa4-af78-0f68c88d768a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Acquiring lock "cinder-quobyte-60294eaf-fef4-4fa4-af78-0f68c88d768a" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Lock "cinder-quobyte-60294eaf-fef4-4fa4-af78-0f68c88d768a" acquired by "delete_volume" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:15 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00932ab-4dca-49b5-a61b-ea9abf9f4eaa]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:15 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a Nov 03 20:23:15 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:15 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a" returned: 0 in 0.402s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:15 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a Nov 03 20:23:15 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:15 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-60294eaf-fef4-4fa4-af78-0f68c88d768a" returned: 0 in 0.318s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Lock "cinder-quobyte-60294eaf-fef4-4fa4-af78-0f68c88d768a" released by "delete_volume" :: held 0.799s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] Creating offline snapshot 73a719b3-bd2d-4d58-a991-fee55a43c320 of volume 91fa93b7-eb93-4b88-abd3-e93bce810126 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15de508d-5582-4fd4-8d69-23cca77312ec]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Created reservations ['12eabd91-36ab-44a5-8178-bba8cfed33e6', 'cff01113-49ce-43cc-8110-1ede33a31af1', '72bdea6d-72d7-4794-b5e6-e28d612a39c4', 'ea81c19c-fdb7-4578-8c56-13d3b72c2b6e'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:16 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:23:16 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:16 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 Nov 03 20:23:16 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Acquiring lock "cinder-8caf414a-d505-4d7f-b31c-c375aa53b56d-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Lock "cinder-8caf414a-d505-4d7f-b31c-c375aa53b56d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Acquiring lock "cinder-quobyte-8caf414a-d505-4d7f-b31c-c375aa53b56d" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Lock "cinder-quobyte-8caf414a-d505-4d7f-b31c-c375aa53b56d" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf57fa1-ddc6-4aea-8f60-8d12afc3c96f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:16 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.391s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:23:16 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Deleted volume successfully. Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-905b7a5c-c91f-4f8d-85c6-15a7a88651f2 tempest-VolumesTestJSON-26395585 None] Lock "cinder-60294eaf-fef4-4fa4-af78-0f68c88d768a-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:16 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126" returned: 0 in 0.611s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:16 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 1G Nov 03 20:23:16 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:16 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d Nov 03 20:23:16 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:17 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d" returned: 0 in 0.453s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:17 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d Nov 03 20:23:17 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:17 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 1G" returned: 0 in 0.565s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91fa93b7-eb93-4b88-abd3-e93bce810126 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:17 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91fa93b7-eb93-4b88-abd3-e93bce810126 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 Nov 03 20:23:17 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:17 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8caf414a-d505-4d7f-b31c-c375aa53b56d" returned: 0 in 0.364s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Lock "cinder-quobyte-8caf414a-d505-4d7f-b31c-c375aa53b56d" released by "delete_volume" :: held 0.893s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Created reservations ['3fc856b5-3f02-4726-93c6-4e9144b11a3d', '91c2b2e1-a27b-4d14-ba19-064fc50f5f8d', '5d59b58e-d083-4464-85e5-e466b3357508', '05bc0c52-1f48-4629-b85a-81a98cd39374'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:17 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:23:17 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:17 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91fa93b7-eb93-4b88-abd3-e93bce810126 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320" returned: 0 in 0.411s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:17 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 is being set with open permissions: ugo+rw Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Acquiring lock "cinder-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:17 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 Nov 03 20:23:17 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Lock "cinder-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Acquiring lock "cinder-quobyte-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Lock "cinder-quobyte-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c31cea1-befa-4a74-be94-17a2fd01ac93]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:17 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.323s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:23:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Deleted volume successfully. Nov 03 20:23:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b457fc7-23e5-44ca-8bdf-eb817e65de87 tempest-VolumesTestJSON-26395585 None] Lock "cinder-8caf414a-d505-4d7f-b31c-c375aa53b56d-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:17 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f Nov 03 20:23:17 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:18 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320" returned: 0 in 0.390s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:18 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.info Nov 03 20:23:18 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:18 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f" returned: 0 in 0.426s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:18 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f Nov 03 20:23:18 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:18 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.info" returned: 0 in 0.299s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:18 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.info is being set with open permissions: ugo+rw Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:18 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.info Nov 03 20:23:18 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:18 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f" returned: 0 in 0.313s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Lock "cinder-quobyte-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f" released by "delete_volume" :: held 0.801s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Created reservations ['e33beaf2-f9e1-4912-b820-a51b2bd598a1', 'e8474e33-8bca-4345-9e35-e64408c44657', '5fc55f7e-4a38-46a0-9f5b-787074c755e8', '8733965d-3925-4e48-895a-d51239146ab0'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:18 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.info" returned: 0 in 0.316s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.733s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:18 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:23:18 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:18 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-51ce4d31-2c1d-4e99-8fbf-ce85f84578fb tempest-SnapshotMetadataTestJSON-926737283 None] Create snapshot completed successfully Nov 03 20:23:19 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.282s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:19 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:23:19 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Deleted volume successfully. Nov 03 20:23:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fd83ab13-04bc-4696-bb32-d70431afb4c1 tempest-VolumesTestJSON-26395585 None] Lock "cinder-ff4a2626-0dbd-41e9-ae6c-73d8b6299b4f-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Acquiring lock "cinder-73a719b3-bd2d-4d58-a991-fee55a43c320-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "cinder-73a719b3-bd2d-4d58-a991-fee55a43c320-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Acquiring lock "cinder-quobyte-91fa93b7-eb93-4b88-abd3-e93bce810126" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "cinder-quobyte-91fa93b7-eb93-4b88-abd3-e93bce810126" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Acquiring lock "cinder-quobyte-73a719b3-bd2d-4d58-a991-fee55a43c320" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "cinder-quobyte-73a719b3-bd2d-4d58-a991-fee55a43c320" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Deleting offline snapshot 73a719b3-bd2d-4d58-a991-fee55a43c320 of volume 91fa93b7-eb93-4b88-abd3-e93bce810126 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] snapshot_file for this snap is: volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[86935391-4943-4f7c-81de-56364950f691]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:21 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 Nov 03 20:23:21 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d940f0e1-9413-4e73-b133-0b020fb5345e tempest-VolumesActionsTest-914127801 None] Acquiring lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1" by "attach_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d940f0e1-9413-4e73-b133-0b020fb5345e tempest-VolumesActionsTest-914127801 None] Lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1" acquired by "attach_volume" :: waited 0.072s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:21 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320" returned: 0 in 0.629s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91fa93b7-eb93-4b88-abd3-e93bce810126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d485724-6d95-464c-b9a0-4857fc768db7]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:22 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d940f0e1-9413-4e73-b133-0b020fb5345e tempest-VolumesActionsTest-914127801 None] Attaching volume 9969d3a1-d353-4145-bc22-2b354f44e6f1 to instance 7bb23af2-897b-4339-b7a0-9320b6c61f6a at mountpoint /dev/vdb on host None. Nov 03 20:23:22 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d940f0e1-9413-4e73-b133-0b020fb5345e tempest-VolumesActionsTest-914127801 None] Attach volume completed successfully. Nov 03 20:23:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d940f0e1-9413-4e73-b133-0b020fb5345e tempest-VolumesActionsTest-914127801 None] Lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1" released by "attach_volume" :: held 0.181s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:22 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 Nov 03 20:23:22 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:22 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126" returned: 0 in 0.544s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:22 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 Nov 03 20:23:22 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9b7965d8-bcde-4c33-8dff-2bf52f71ddfc tempest-VolumesActionsTest-914127801 None] Acquiring lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1-detach_volume" by "detach_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9b7965d8-bcde-4c33-8dff-2bf52f71ddfc tempest-VolumesActionsTest-914127801 None] Lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:22 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-9b7965d8-bcde-4c33-8dff-2bf52f71ddfc tempest-VolumesActionsTest-914127801 None] Detaching volume 9969d3a1-d353-4145-bc22-2b354f44e6f1 from instance 7bb23af2-897b-4339-b7a0-9320b6c61f6a. Nov 03 20:23:22 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-9b7965d8-bcde-4c33-8dff-2bf52f71ddfc tempest-VolumesActionsTest-914127801 None] Detach volume completed successfully. Nov 03 20:23:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9b7965d8-bcde-4c33-8dff-2bf52f71ddfc tempest-VolumesActionsTest-914127801 None] Lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1-detach_volume" released by "detach_volume" :: held 0.172s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:23 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320" returned: 0 in 0.538s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:23 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320 Nov 03 20:23:23 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:23 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126.73a719b3-bd2d-4d58-a991-fee55a43c320" returned: 0 in 0.460s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "cinder-quobyte-73a719b3-bd2d-4d58-a991-fee55a43c320" released by "_delete_snapshot" :: held 2.392s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "cinder-quobyte-91fa93b7-eb93-4b88-abd3-e93bce810126" released by "delete_snapshot" :: held 2.426s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:23 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:23:23 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Created reservations ['4713650c-1dc3-45fc-b3ea-4360f251cc7d', 'fdba2476-d11b-48ab-a3cf-692c7f0429e3', '82cd086e-b4b8-42b6-b699-2cfdbebea8cb', '6af5983b-c4fe-4dc9-bffa-278b1750ffe7'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=120,cinder:INSERT=36,cinder:UPDATE=141,cinder:DELETE=15 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:23:23 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Delete snapshot completed successfully. Nov 03 20:23:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7e73a0-8c30-46d2-88e6-255705dbd4d0 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "cinder-73a719b3-bd2d-4d58-a991-fee55a43c320-delete_snapshot" released by "delete_snapshot" :: held 2.790s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:24 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.442s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:23:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:23:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 8 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:23:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:23:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Acquiring lock "cinder-91fa93b7-eb93-4b88-abd3-e93bce810126-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "cinder-91fa93b7-eb93-4b88-abd3-e93bce810126-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Acquiring lock "cinder-quobyte-91fa93b7-eb93-4b88-abd3-e93bce810126" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "cinder-quobyte-91fa93b7-eb93-4b88-abd3-e93bce810126" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:24 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b53ed95-2eda-49ee-a9c0-dec7f39d6a26]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:24 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 Nov 03 20:23:24 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:25 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126" returned: 0 in 0.476s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:25 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126 Nov 03 20:23:25 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:25 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-91fa93b7-eb93-4b88-abd3-e93bce810126" returned: 0 in 0.283s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "cinder-quobyte-91fa93b7-eb93-4b88-abd3-e93bce810126" released by "delete_volume" :: held 0.889s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=136,cinder:UPDATE=149,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Created reservations ['0a1c4ce5-ad6a-45b6-be39-c560ae8f48ff', '839a501a-02df-48dc-a984-9e6326ff5dc2', 'eb6ba898-302f-4bc4-b12e-c7e88c8a848c', 'cc6feefd-fa73-438e-96d8-23a7795c779b'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:25 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:23:25 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:25 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.284s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:23:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Deleted volume successfully. Nov 03 20:23:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51695e9b-db48-4945-81eb-db16b08c6472 tempest-SnapshotMetadataTestJSON-926737283 None] Lock "cinder-91fa93b7-eb93-4b88-abd3-e93bce810126-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:28 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2323dd9-dce0-4665-8ded-bebf0f2457cb]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:28 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 Nov 03 20:23:28 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:28 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1" returned: 0 in 0.431s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:28 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d00bb8-12e4-4ee9-a077-0c621c090097]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:28 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 Nov 03 20:23:28 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:29 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1" returned: 0 in 0.437s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.2b877280-615d-4522-8f64-93ed3b28161brtlooh90.img {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:29 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.2b877280-615d-4522-8f64-93ed3b28161brtlooh90.img Nov 03 20:23:29 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc1bf3a1-fd3d-4102-a824-529d6afce71d tempest-BackendsCapabilitiesAdminTestsJSON-2059796837 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6631889343262, 'free_capacity_gb': 1773.6631889343262, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87342) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 20:23:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b1336f9-d430-4914-ac6f-4fb8bfe106ee tempest-BackendsCapabilitiesAdminTestsJSON-2059796837 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6631889343262, 'free_capacity_gb': 1773.6631889343262, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87342) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Flow 'volume_create_manager' (1060c1f5-1e8d-4ae7-87b0-2c344257c06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc8631f-eabb-4c40-a743-0d4d637a44f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc8631f-eabb-4c40-a743-0d4d637a44f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-612597558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2c26e2-2429-4d27-9efc-81f7281a800a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9979db02a672402a90678b4e3711315f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:31Z,use_quota=True,user_id='381ba8c545e240df88124e69c6d74b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f55145-ec8c-453d-8ab0-7bec6a78ab93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f55145-ec8c-453d-8ab0-7bec6a78ab93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891ca26f-0bc7-4869-8aaa-f7dfd2a1d7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891ca26f-0bc7-4869-8aaa-f7dfd2a1d7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2c26e2-2429-4d27-9efc-81f7281a800a', 'volume_name': 'volume-5b2c26e2-2429-4d27-9efc-81f7281a800a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59813aa8-6da7-418f-a1ad-c21cecf00efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59813aa8-6da7-418f-a1ad-c21cecf00efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2ceb09-485c-48da-a422-9dd160592294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:31 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Volume 5b2c26e2-2429-4d27-9efc-81f7281a800a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2c26e2-2429-4d27-9efc-81f7281a800a', 'volume_size': 1} Nov 03 20:23:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:36 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.2b877280-615d-4522-8f64-93ed3b28161brtlooh90.img" returned: 0 in 7.347s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:36 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b304e0-62a8-4867-b54b-6540d847ed62]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:36 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 Nov 03 20:23:36 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:37 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1" returned: 0 in 0.525s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:37 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.2b877280-615d-4522-8f64-93ed3b28161brtlooh90.img {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:23:37 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] Converted 1024.00 MB image at 139.37 MB/s Nov 03 20:23:37 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] 2b877280-615d-4522-8f64-93ed3b28161b was raw, no need to convert to raw {{(pid=87342) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 20:23:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0cc2c892-1f98-4c47-8fa3-fc36d3528fba tempest-GroupsTest-1235949934 None] Group tempest-Group1-869376980: creating Nov 03 20:23:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0cc2c892-1f98-4c47-8fa3-fc36d3528fba tempest-GroupsTest-1235949934 None] Group tempest-Group1-869376980: created successfully Nov 03 20:23:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0cc2c892-1f98-4c47-8fa3-fc36d3528fba tempest-GroupsTest-1235949934 None] Create group completed successfully. Nov 03 20:23:46 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-92986404-92af-4bbd-9ff9-f8bc6d5d143b tempest-GroupsTest-1235949934 None] Group tempest-Group2-1016186103: creating Nov 03 20:23:46 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-92986404-92af-4bbd-9ff9-f8bc6d5d143b tempest-GroupsTest-1235949934 None] Group tempest-Group2-1016186103: created successfully Nov 03 20:23:46 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-92986404-92af-4bbd-9ff9-f8bc6d5d143b tempest-GroupsTest-1235949934 None] Create group completed successfully. Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Flow 'volume_create_manager' (2ba267f1-03e9-4f4a-97b0-654de764e2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74f529d-82f2-4ff8-9449-2ba28fc8078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74f529d-82f2-4ff8-9449-2ba28fc8078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2029285622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb10310d-1af9-4644-971d-9b9001922d57,host='devstack@QuobyteHD#QuobyteHD',id=fdd715c4-b19e-449e-ac22-e2e00651ef44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fff027dd4149538d8f47cfac39e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:48Z,use_quota=True,user_id='c96eb627456b4c2b93fe69587ca319b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e25661b-6955-495b-9170-d368300f6b54),volume_type_id=4e25661b-6955-495b-9170-d368300f6b54)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e642d8-20e1-42fa-8024-b2c45edd2bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e642d8-20e1-42fa-8024-b2c45edd2bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683adf52-5070-4b17-bff6-914fd4d68481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683adf52-5070-4b17-bff6-914fd4d68481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd715c4-b19e-449e-ac22-e2e00651ef44', 'volume_name': 'volume-fdd715c4-b19e-449e-ac22-e2e00651ef44', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c3fb78-346c-4c59-a2b7-6cca19745fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c3fb78-346c-4c59-a2b7-6cca19745fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732f951b-8aa0-4045-96cc-3ce4c6bf667d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:48 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Volume fdd715c4-b19e-449e-ac22-e2e00651ef44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd715c4-b19e-449e-ac22-e2e00651ef44', 'volume_size': 1} Nov 03 20:23:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.019s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] Uploaded volume to glance image-id: 2b877280-615d-4522-8f64-93ed3b28161b. {{(pid=87342) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.103s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-612597558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2c26e2-2429-4d27-9efc-81f7281a800a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9979db02a672402a90678b4e3711315f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:31Z,use_quota=True,user_id='381ba8c545e240df88124e69c6d74b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Creating volume 5b2c26e2-2429-4d27-9efc-81f7281a800a {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:56 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:56 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a 1073741824 Nov 03 20:23:56 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:56 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e6993b97-05b0-45c1-bd52-1bd71b6e040a tempest-VolumesActionsTest-914127801 None] Copy volume to image completed successfully. Nov 03 20:23:56 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a 1073741824" returned: 0 in 0.456s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:56 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a Nov 03 20:23:56 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:57 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.888s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bb10310d-1af9-4644-971d-9b9001922d57,created_at=2026-11-03T19:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2029285622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb10310d-1af9-4644-971d-9b9001922d57,host='devstack@QuobyteHD#QuobyteHD',id=fdd715c4-b19e-449e-ac22-e2e00651ef44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fff027dd4149538d8f47cfac39e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:48Z,use_quota=True,user_id='c96eb627456b4c2b93fe69587ca319b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e25661b-6955-495b-9170-d368300f6b54),volume_type_id=4e25661b-6955-495b-9170-d368300f6b54)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Creating volume fdd715c4-b19e-449e-ac22-e2e00651ef44 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:57 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2ceb09-485c-48da-a422-9dd160592294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2c26e2-2429-4d27-9efc-81f7281a800a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:57 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44 1073741824 Nov 03 20:23:57 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1f6418-f926-4fe9-b619-c4c253f176c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:57 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Volume volume-5b2c26e2-2429-4d27-9efc-81f7281a800a (5b2c26e2-2429-4d27-9efc-81f7281a800a): created successfully Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1f6418-f926-4fe9-b619-c4c253f176c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Flow 'volume_create_manager' (1060c1f5-1e8d-4ae7-87b0-2c344257c06e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:57 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a62c156e-9573-465a-9415-f5cf8588f420 tempest-VolumesDeleteCascade-484326236 None] Created volume successfully. Nov 03 20:23:57 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44 1073741824" returned: 0 in 0.465s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:57 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44 Nov 03 20:23:57 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:57 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44" returned: 0 in 0.247s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.214s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732f951b-8aa0-4045-96cc-3ce4c6bf667d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd715c4-b19e-449e-ac22-e2e00651ef44', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20313d85-e81a-43ef-a09c-09239e5e7b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[62190669-4938-491a-b29b-213855060aa7]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:57 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Volume volume-fdd715c4-b19e-449e-ac22-e2e00651ef44 (fdd715c4-b19e-449e-ac22-e2e00651ef44): created successfully Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20313d85-e81a-43ef-a09c-09239e5e7b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Flow 'volume_create_manager' (2ba267f1-03e9-4f4a-97b0-654de764e2bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:58 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d7e8a4ec-2e14-42f2-b8e1-ed438f6ad103 tempest-GroupsTest-1235949934 None] Created volume successfully. Nov 03 20:23:58 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 Nov 03 20:23:58 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:58 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1" returned: 0 in 0.375s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:58 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[def2987e-8c11-494b-b289-be9fcb7c4d3c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:58 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 Nov 03 20:23:58 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:58 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1" returned: 0 in 0.378s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:58 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img Nov 03 20:23:58 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Acquiring lock "cinder-quobyte-fdd715c4-b19e-449e-ac22-e2e00651ef44" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Lock "cinder-quobyte-fdd715c4-b19e-449e-ac22-e2e00651ef44" acquired by "delete_volume" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:59 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f287b88-6151-4064-9e76-59d98fc6137c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:59 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44 Nov 03 20:23:59 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:00 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44" returned: 0 in 0.599s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:00 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44 Nov 03 20:24:00 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:00 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdd715c4-b19e-449e-ac22-e2e00651ef44" returned: 0 in 0.427s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Lock "cinder-quobyte-fdd715c4-b19e-449e-ac22-e2e00651ef44" released by "delete_volume" :: held 1.127s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:00 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Created reservations ['cb9ee11b-3525-472e-ad4f-691b88b77bc6'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:00 devstack cinder-volume[87342]: WARNING cinder.quota [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-568136461 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-568136461, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:24:00 devstack cinder-volume[87342]: WARNING cinder.quota [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-568136461 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-568136461, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:24:00 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Created reservations ['6b59a2a6-a2a3-4957-8bdc-b096c89d970a', '42ac60e5-b373-46e5-bb79-09b70cfc639f', '076390e4-e8ca-4f89-a239-d9c54e13695b', 'f7577399-8d2d-4c44-b98b-05982a1281ad'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:01 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:01 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:01 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.339s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:01 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:01 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-52bb6c77-a45f-4daf-85e7-71ae088d709b tempest-GroupsTest-1235949934 None] Delete group completed successfully. Nov 03 20:24:02 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ace7463f-1698-4a27-a9eb-182895b5202f tempest-GroupsTest-1235949934 None] Created reservations ['5f1151b8-15c8-4323-b619-f8f9a24e45ec'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ace7463f-1698-4a27-a9eb-182895b5202f tempest-GroupsTest-1235949934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ace7463f-1698-4a27-a9eb-182895b5202f tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ace7463f-1698-4a27-a9eb-182895b5202f tempest-GroupsTest-1235949934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ace7463f-1698-4a27-a9eb-182895b5202f tempest-GroupsTest-1235949934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ace7463f-1698-4a27-a9eb-182895b5202f tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ace7463f-1698-4a27-a9eb-182895b5202f tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:02 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:02 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:02 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ace7463f-1698-4a27-a9eb-182895b5202f tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.300s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:02 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-ace7463f-1698-4a27-a9eb-182895b5202f tempest-GroupsTest-1235949934 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:02 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ace7463f-1698-4a27-a9eb-182895b5202f tempest-GroupsTest-1235949934 None] Delete group completed successfully. Nov 03 20:24:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ba9a55cf-ef20-453a-a697-4f80497a98d7 tempest-GroupsTest-1235949934 None] Group tempest-GroupsTest-Group-90959327: creating Nov 03 20:24:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ba9a55cf-ef20-453a-a697-4f80497a98d7 tempest-GroupsTest-1235949934 None] Group tempest-GroupsTest-Group-90959327: created successfully Nov 03 20:24:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ba9a55cf-ef20-453a-a697-4f80497a98d7 tempest-GroupsTest-1235949934 None] Create group completed successfully. Nov 03 20:24:05 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img" returned: 0 in 6.457s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[549fbf49-cf6a-4faa-8eb5-642cb0e242cd]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:05 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 Nov 03 20:24:05 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:05 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1" returned: 0 in 0.547s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:24:05 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Converted 1024.00 MB image at 158.57 MB/s Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61 was raw, converting to qcow2 {{(pid=87342) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bc0ae3-c75f-4e35-a9a5-1a84595ca451]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:05 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img Nov 03 20:24:05 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Flow 'volume_create_manager' (8fd87c7f-ae21-4960-85dd-c8b49f99b811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404b1177-63b9-495d-a31d-0f53193b7bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404b1177-63b9-495d-a31d-0f53193b7bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-869821919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=adc0d5fa-c835-42c1-825a-1b9f966dd755,host='devstack@QuobyteHD#QuobyteHD',id=16c027e9-b4cd-41ff-aa39-3349521fc665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fff027dd4149538d8f47cfac39e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:06Z,use_quota=True,user_id='c96eb627456b4c2b93fe69587ca319b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8365193f-4513-4a0a-963a-a95c1fb7c540),volume_type_id=8365193f-4513-4a0a-963a-a95c1fb7c540)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78b6790-3989-464d-87f8-695861e698f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78b6790-3989-464d-87f8-695861e698f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be94d4ee-ef46-4bc9-9c80-0ae411b64fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be94d4ee-ef46-4bc9-9c80-0ae411b64fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16c027e9-b4cd-41ff-aa39-3349521fc665', 'volume_name': 'volume-16c027e9-b4cd-41ff-aa39-3349521fc665', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a6753-c45f-493b-9335-b79e49981057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a6753-c45f-493b-9335-b79e49981057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29077c3-7f04-4e2b-9c7b-b0e6a7d473e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:05 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Volume 16c027e9-b4cd-41ff-aa39-3349521fc665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16c027e9-b4cd-41ff-aa39-3349521fc665', 'volume_size': 1} Nov 03 20:24:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:06 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img" returned: 0 in 0.331s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:06 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img Nov 03 20:24:06 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:06 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img" returned: 1 in 0.329s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:24:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img /opt/stack/data/cinder/conversion/vol_upload_5xfat187 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:06 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img /opt/stack/data/cinder/conversion/vol_upload_5xfat187 Nov 03 20:24:06 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:06 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img /opt/stack/data/cinder/conversion/vol_upload_5xfat187" returned: 0 in 0.246s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:06 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Image conversion details: src /opt/stack/data/cinder/conversion/9969d3a1-d353-4145-bc22-2b354f44e6f1.temp_image.bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61y9c30wqt.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5xfat187 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:24:06 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 20:24:06 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6b690f-e93f-4bcb-b5be-83cb3174d98e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5xfat187 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:06 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5xfat187 Nov 03 20:24:06 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:06 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5xfat187" returned: 0 in 0.318s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.318s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Uploaded volume to glance image-id: bb1d04dd-4c4c-4e6e-aff2-a6a079d93c61. {{(pid=87342) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 20:24:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.084s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] Creating offline snapshot 4a85c924-9877-4825-96dc-9118e941cb5a of volume 5b2c26e2-2429-4d27-9efc-81f7281a800a {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:24:08 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-780f6df0-2195-47a5-8fd2-65ad79f0b6a7 tempest-VolumesActionsTest-914127801 None] Copy volume to image completed successfully. Nov 03 20:24:08 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a68eb18-8f9e-4c8e-8717-eb292d0855b0]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:08 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a Nov 03 20:24:08 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:08 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a" returned: 0 in 0.361s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:08 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a 1G Nov 03 20:24:08 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:09 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a 1G" returned: 0 in 0.370s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2c26e2-2429-4d27-9efc-81f7281a800a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:09 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2c26e2-2429-4d27-9efc-81f7281a800a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a Nov 03 20:24:09 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:09 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2c26e2-2429-4d27-9efc-81f7281a800a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a" returned: 0 in 0.314s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:09 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a is being set with open permissions: ugo+rw Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:09 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a Nov 03 20:24:09 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:09 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a" returned: 0 in 0.267s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:09 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.info Nov 03 20:24:09 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Acquiring lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Acquiring lock "cinder-quobyte-9969d3a1-d353-4145-bc22-2b354f44e6f1" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Lock "cinder-quobyte-9969d3a1-d353-4145-bc22-2b354f44e6f1" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:09 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.info" returned: 0 in 0.286s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:09 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.info is being set with open permissions: ugo+rw Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c1f17b-6aad-4389-8971-5c02ff4d1d17]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:09 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.info Nov 03 20:24:09 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:10 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 Nov 03 20:24:10 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:10 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.info" returned: 0 in 0.246s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.234s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=adc0d5fa-c835-42c1-825a-1b9f966dd755,created_at=2026-11-03T19:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-869821919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=adc0d5fa-c835-42c1-825a-1b9f966dd755,host='devstack@QuobyteHD#QuobyteHD',id=16c027e9-b4cd-41ff-aa39-3349521fc665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fff027dd4149538d8f47cfac39e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:06Z,use_quota=True,user_id='c96eb627456b4c2b93fe69587ca319b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8365193f-4513-4a0a-963a-a95c1fb7c540),volume_type_id=8365193f-4513-4a0a-963a-a95c1fb7c540)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Creating volume 16c027e9-b4cd-41ff-aa39-3349521fc665 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:10 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:10 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665 1073741824 Nov 03 20:24:10 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4780d4e6-67bb-4e92-a350-9d6d9e726902 tempest-VolumesDeleteCascade-484326236 None] Create snapshot completed successfully Nov 03 20:24:10 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1" returned: 0 in 0.387s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:10 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1 Nov 03 20:24:10 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:10 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9969d3a1-d353-4145-bc22-2b354f44e6f1" returned: 0 in 0.288s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Lock "cinder-quobyte-9969d3a1-d353-4145-bc22-2b354f44e6f1" released by "delete_volume" :: held 0.732s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:10 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665 1073741824" returned: 0 in 0.519s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Created reservations ['350905aa-f01b-4d8a-a80c-965f801115b0', '47312345-ac46-478d-b99b-8338bebe3255', '7279324f-739f-41de-942d-55b16f201a18', '89b24ea1-fff0-47ba-a104-844a5804de09'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:10 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665 Nov 03 20:24:10 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:10 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:10 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:11 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665" returned: 0 in 0.377s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.176s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:11 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29077c3-7f04-4e2b-9c7b-b0e6a7d473e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c027e9-b4cd-41ff-aa39-3349521fc665', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c19c3ee-a9c9-4981-9e09-4ebd2a74d0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] Creating offline snapshot 3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e of volume 5b2c26e2-2429-4d27-9efc-81f7281a800a {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.382s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:11 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Deleted volume successfully. Nov 03 20:24:11 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Volume volume-16c027e9-b4cd-41ff-aa39-3349521fc665 (16c027e9-b4cd-41ff-aa39-3349521fc665): created successfully Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c19c3ee-a9c9-4981-9e09-4ebd2a74d0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Flow 'volume_create_manager' (8fd87c7f-ae21-4960-85dd-c8b49f99b811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac2f409-fb87-4e2b-8e5a-285d828438ba]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0c99655e-fe08-40af-9719-54a8756c821d tempest-VolumesActionsTest-914127801 None] Lock "cinder-9969d3a1-d353-4145-bc22-2b354f44e6f1-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:11 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f02a4e6a-c0fd-4a0a-baae-70ad083aff80 tempest-GroupsTest-1235949934 None] Created volume successfully. Nov 03 20:24:11 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a Nov 03 20:24:11 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:11 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a" returned: 0 in 0.441s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b2c26e2-2429-4d27-9efc-81f7281a800a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:24:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:11 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e 1G Nov 03 20:24:11 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:12 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e 1G" returned: 0 in 0.626s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:12 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e Nov 03 20:24:12 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Flow 'volume_create_manager' (3e96f0da-41b6-4f52-9fb5-679768e9478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db51de80-7a6b-4b82-ba53-d6e99c236cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db51de80-7a6b-4b82-ba53-d6e99c236cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1583906325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=adc0d5fa-c835-42c1-825a-1b9f966dd755,host='devstack@QuobyteHD#QuobyteHD',id=ddf2b6de-2ae4-4976-bd5a-52209d0b525e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fff027dd4149538d8f47cfac39e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:12Z,use_quota=True,user_id='c96eb627456b4c2b93fe69587ca319b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8365193f-4513-4a0a-963a-a95c1fb7c540),volume_type_id=8365193f-4513-4a0a-963a-a95c1fb7c540)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a2d612-00ac-4f1c-93d4-b98ee47377a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a2d612-00ac-4f1c-93d4-b98ee47377a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cf4eef-fcee-4a66-9cbf-a963f03dde6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cf4eef-fcee-4a66-9cbf-a963f03dde6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf2b6de-2ae4-4976-bd5a-52209d0b525e', 'volume_name': 'volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa1a203-1b31-40e9-a5b6-022e2e213b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa1a203-1b31-40e9-a5b6-022e2e213b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27849f7-f5ca-42c6-a516-c6429b755ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:12 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Volume ddf2b6de-2ae4-4976-bd5a-52209d0b525e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e', 'volume_size': 1} Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:12 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e" returned: 0 in 0.361s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:12 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e is being set with open permissions: ugo+rw Nov 03 20:24:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:12 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e Nov 03 20:24:12 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:13 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e" returned: 0 in 0.280s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=adc0d5fa-c835-42c1-825a-1b9f966dd755,created_at=2026-11-03T19:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1583906325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=adc0d5fa-c835-42c1-825a-1b9f966dd755,host='devstack@QuobyteHD#QuobyteHD',id=ddf2b6de-2ae4-4976-bd5a-52209d0b525e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fff027dd4149538d8f47cfac39e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:12Z,use_quota=True,user_id='c96eb627456b4c2b93fe69587ca319b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8365193f-4513-4a0a-963a-a95c1fb7c540),volume_type_id=8365193f-4513-4a0a-963a-a95c1fb7c540)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Creating volume ddf2b6de-2ae4-4976-bd5a-52209d0b525e {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:13 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:13 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e 1073741824 Nov 03 20:24:13 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:13 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-844429ab-f039-44ec-b648-360836b1ce44 tempest-VolumesDeleteCascade-484326236 None] Create snapshot completed successfully Nov 03 20:24:13 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e 1073741824" returned: 0 in 0.510s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:13 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e Nov 03 20:24:13 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:13 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27849f7-f5ca-42c6-a516-c6429b755ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c601cd3c-cea3-4ce7-a20d-0ad1b3878df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:13 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Volume volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e (ddf2b6de-2ae4-4976-bd5a-52209d0b525e): created successfully Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c601cd3c-cea3-4ce7-a20d-0ad1b3878df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Flow 'volume_create_manager' (3e96f0da-41b6-4f52-9fb5-679768e9478a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:13 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b1364f74-189f-4e2d-99a2-7e211af2b135 tempest-GroupsTest-1235949934 None] Created volume successfully. Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-5b2c26e2-2429-4d27-9efc-81f7281a800a-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-5b2c26e2-2429-4d27-9efc-81f7281a800a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Performing cascade delete. {{(pid=87342) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-quobyte-5b2c26e2-2429-4d27-9efc-81f7281a800a" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-5b2c26e2-2429-4d27-9efc-81f7281a800a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-quobyte-3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Deleting offline snapshot 3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e of volume 5b2c26e2-2429-4d27-9efc-81f7281a800a {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] snapshot_file for this snap is: volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab225670-b911-4f1c-a299-fa15b112b8de]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:14 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e Nov 03 20:24:14 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:14 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e" returned: 0 in 0.389s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b2c26e2-2429-4d27-9efc-81f7281a800a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f08d8a9-0411-4c2b-b3cd-b0dcb619d055]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:14 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a Nov 03 20:24:14 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:14 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f549a256-a655-448b-9c50-33de4d0992ee tempest-GroupsTest-1235949934 None] Update group completed successfully. Nov 03 20:24:15 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a" returned: 0 in 0.438s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b2c26e2-2429-4d27-9efc-81f7281a800a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:24:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:15 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e Nov 03 20:24:15 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:15 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e" returned: 0 in 0.412s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:15 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e Nov 03 20:24:15 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:15 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e" returned: 0 in 0.279s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e" released by "_delete_snapshot" :: held 1.636s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-5b2c26e2-2429-4d27-9efc-81f7281a800a" released by "delete_snapshot" :: held 1.657s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:15 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Created reservations ['ffdf395d-d0af-4e66-b520-86eddf60c2c3', '321e8f55-84fa-4e67-8d7f-32eca1c29bc7', '77083c7a-835a-4dd0-8ca1-0a20fb0a2778', '15f7ebed-1b04-474d-888c-3f354ef0cfb1'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:16 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Delete snapshot completed successfully. Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-3c9ce99d-d12f-4b0f-8b94-1ea6a390a05e-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-4a85c924-9877-4825-96dc-9118e941cb5a-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-4a85c924-9877-4825-96dc-9118e941cb5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-quobyte-5b2c26e2-2429-4d27-9efc-81f7281a800a" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-5b2c26e2-2429-4d27-9efc-81f7281a800a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-quobyte-4a85c924-9877-4825-96dc-9118e941cb5a" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-4a85c924-9877-4825-96dc-9118e941cb5a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Deleting offline snapshot 4a85c924-9877-4825-96dc-9118e941cb5a of volume 5b2c26e2-2429-4d27-9efc-81f7281a800a {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] snapshot_file for this snap is: volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cfaab9-e716-4d37-9cff-16fc11a309a9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:16 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a Nov 03 20:24:16 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:16 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d2974dd2-8dc1-4cc4-99db-189d902675e8 tempest-GroupsTest-1235949934 None] Update group completed successfully. Nov 03 20:24:16 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a" returned: 0 in 0.465s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b2c26e2-2429-4d27-9efc-81f7281a800a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37b756b-a9d3-4e91-b496-5c07b60cb91f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:16 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a Nov 03 20:24:16 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:17 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a" returned: 0 in 0.370s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:17 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a Nov 03 20:24:17 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:17 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a" returned: 0 in 0.386s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:17 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a Nov 03 20:24:17 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:17 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a.4a85c924-9877-4825-96dc-9118e941cb5a" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-4a85c924-9877-4825-96dc-9118e941cb5a" released by "_delete_snapshot" :: held 1.597s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-5b2c26e2-2429-4d27-9efc-81f7281a800a" released by "delete_snapshot" :: held 1.626s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Created reservations ['9b979366-ed06-4d22-8063-297302af76d8', '9ae456ff-ba9f-439d-9e6d-c7d58d078cfe', '83702b66-fd53-4180-9904-a487cfbadb54', '4b9a0c12-8977-46d5-a60d-c8b27ac3fd4c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Delete snapshot completed successfully. Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-4a85c924-9877-4825-96dc-9118e941cb5a-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Snapshots deleted, issuing volume delete {{(pid=87342) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-quobyte-5b2c26e2-2429-4d27-9efc-81f7281a800a" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-5b2c26e2-2429-4d27-9efc-81f7281a800a" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[51009cd3-d54c-461e-b1ea-62183769569a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Acquiring lock "cinder-quobyte-16c027e9-b4cd-41ff-aa39-3349521fc665" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Lock "cinder-quobyte-16c027e9-b4cd-41ff-aa39-3349521fc665" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[951211f8-c045-44d6-ab82-ddbed17913b3]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:18 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a Nov 03 20:24:18 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:18 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665 Nov 03 20:24:18 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:18 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a" returned: 0 in 0.402s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:18 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a Nov 03 20:24:18 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:18 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665" returned: 0 in 0.434s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:18 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665 Nov 03 20:24:18 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:18 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-5b2c26e2-2429-4d27-9efc-81f7281a800a" returned: 0 in 0.273s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-5b2c26e2-2429-4d27-9efc-81f7281a800a" released by "delete_volume" :: held 0.757s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Created reservations ['50af1aa0-f9c1-4d03-b850-c15fa2bb8247', '08efec97-249b-4273-a7b1-9372c69b4c01', 'a5436f23-5778-46d7-bfc7-2145b3b31248', '1773b598-19b9-41e4-aa8b-6021697402b2'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:18 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16c027e9-b4cd-41ff-aa39-3349521fc665" returned: 0 in 0.260s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Lock "cinder-quobyte-16c027e9-b4cd-41ff-aa39-3349521fc665" released by "delete_volume" :: held 0.777s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Acquiring lock "cinder-quobyte-ddf2b6de-2ae4-4976-bd5a-52209d0b525e" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:18 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Lock "cinder-quobyte-ddf2b6de-2ae4-4976-bd5a-52209d0b525e" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:18 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31415bc-038a-4cf2-a7d7-3d4be92e4a5a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:19 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e Nov 03 20:24:19 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:19 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.297s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:19 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Deleted volume successfully. Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-828af473-9962-47a6-98bb-31ff15a700a9 tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-5b2c26e2-2429-4d27-9efc-81f7281a800a-delete_volume" released by "delete_volume" :: held 5.050s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:19 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e" returned: 0 in 0.399s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:19 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e Nov 03 20:24:19 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Flow 'volume_create_manager' (ce3ffce5-6580-4fc0-9557-97411eb4f696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15ff4f3-8bad-4a02-ba67-8b6164f56176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15ff4f3-8bad-4a02-ba67-8b6164f56176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1157185626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5ac24c-3704-4cf7-ab93-4aa215781926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81f4b967fd24586a010cd85bea733e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:19Z,use_quota=True,user_id='b439427525c448f29fd160e98a21460e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d5df94-f9e5-4441-93f6-2b56b3b86252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d5df94-f9e5-4441-93f6-2b56b3b86252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b59492c-d43c-43a3-bd54-9e678a42597b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.image.glance [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Creating Keystone auth plugin from conf {{(pid=87342) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:24:19 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ddf2b6de-2ae4-4976-bd5a-52209d0b525e" returned: 0 in 0.280s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Lock "cinder-quobyte-ddf2b6de-2ae4-4976-bd5a-52209d0b525e" released by "delete_volume" :: held 0.731s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Created reservations ['7e99f1d4-b94e-4729-9c07-ea24c942db68'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:19 devstack cinder-volume[87342]: WARNING cinder.quota [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-131690718 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-131690718, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:24:19 devstack cinder-volume[87342]: WARNING cinder.quota [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-131690718 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-131690718, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Created reservations ['6e3f0a64-d7c0-443f-ae16-3065cd2ec9c4', '11dea564-07a9-4547-b867-126c4ecb2d96', 'eb4e8bfb-ee48-44f7-b54f-89a70652b28b', '3872c224-3b6f-4c31-a821-ddb779ff0ff7'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b59492c-d43c-43a3-bd54-9e678a42597b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a5ac24c-3704-4cf7-ab93-4aa215781926', 'volume_name': 'volume-3a5ac24c-3704-4cf7-ab93-4aa215781926', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e723b7e7-20bd-4feb-8025-d1124467bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e723b7e7-20bd-4feb-8025-d1124467bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1916b2ce-06c5-4642-b90a-496be8a8ceff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:19 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Volume 3a5ac24c-3704-4cf7-ab93-4aa215781926: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a5ac24c-3704-4cf7-ab93-4aa215781926', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Trying to clone 3a5ac24c-3704-4cf7-ab93-4aa215781926 from image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 at location (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]). {{(pid=87342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:24:19 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Created reservations ['fbd3ef6e-7088-48ff-9b37-8c47b4e67f3f', '246bd6e0-21ec-466a-ba93-ec7244e9eb27', '7c38e880-dc3a-46e4-bab6-0d9abfc3f814', '30d47f0d-b9ce-453e-bc50-bec32f83b438'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:20 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:20 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:24:20 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Image download 20.69 MB at 20.69 MB/s Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[18616776-a012-440a-a586-af99a9edf75b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:20 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD Nov 03 20:24:20 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:20 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.308s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:20 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ba10d936-f9b2-420c-8c54-04e707b74064 tempest-GroupsTest-1235949934 None] Delete group completed successfully. Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Flow 'volume_create_manager' (1da94009-2673-4ff9-b680-1929109e7519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f437b59-09b0-436a-993f-d6ecddb6cbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:20 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f437b59-09b0-436a-993f-d6ecddb6cbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1770003177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63ed620-39ce-43d8-a604-ab98718123c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9979db02a672402a90678b4e3711315f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:21Z,use_quota=True,user_id='381ba8c545e240df88124e69c6d74b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a294c5dc-0870-462d-b25f-fadf3cd2a0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a294c5dc-0870-462d-b25f-fadf3cd2a0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea4444d-3fec-4d64-920a-a42b2b6c802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea4444d-3fec-4d64-920a-a42b2b6c802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f63ed620-39ce-43d8-a604-ab98718123c5', 'volume_name': 'volume-f63ed620-39ce-43d8-a604-ab98718123c5', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a100d89d-bfd1-4053-8974-3b2a9d48d2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a100d89d-bfd1-4053-8974-3b2a9d48d2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c597eb50-60b8-4093-a71d-68a7ef64faf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:20 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Volume f63ed620-39ce-43d8-a604-ab98718123c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f63ed620-39ce-43d8-a604-ab98718123c5', 'volume_size': 1} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1770003177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63ed620-39ce-43d8-a604-ab98718123c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9979db02a672402a90678b4e3711315f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:21Z,use_quota=True,user_id='381ba8c545e240df88124e69c6d74b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Creating volume f63ed620-39ce-43d8-a604-ab98718123c5 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:20 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Temporary image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 is fetched for user b439427525c448f29fd160e98a21460e. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:24:20 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 1073741824 Nov 03 20:24:20 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd0ba15-46ef-4258-a9d6-535748586377]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:20 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD Nov 03 20:24:20 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:21 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 1073741824" returned: 0 in 0.446s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:21 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:21 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 Nov 03 20:24:21 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:21 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1157185626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5ac24c-3704-4cf7-ab93-4aa215781926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81f4b967fd24586a010cd85bea733e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:19Z,use_quota=True,user_id='b439427525c448f29fd160e98a21460e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Creating volume 3a5ac24c-3704-4cf7-ab93-4aa215781926 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:21 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:21 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 1073741824 Nov 03 20:24:21 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c597eb50-60b8-4093-a71d-68a7ef64faf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f63ed620-39ce-43d8-a604-ab98718123c5', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9deb5b6b-b8e2-4bb7-8b2f-5b8e3c133a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:21 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Volume volume-f63ed620-39ce-43d8-a604-ab98718123c5 (f63ed620-39ce-43d8-a604-ab98718123c5): created successfully Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9deb5b6b-b8e2-4bb7-8b2f-5b8e3c133a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Flow 'volume_create_manager' (1da94009-2673-4ff9-b680-1929109e7519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:21 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e677e170-23bb-4e55-8902-b127fca2233a tempest-VolumesDeleteCascade-484326236 None] Created volume successfully. Nov 03 20:24:21 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 1073741824" returned: 0 in 0.458s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:22 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 Nov 03 20:24:22 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:22 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926" returned: 0 in 0.239s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Attempting download of 82b2f310-b2ab-4d6d-9d32-5c0ace417816 ((None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}])) to volume 3a5ac24c-3704-4cf7-ab93-4aa215781926. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1936bc-6aef-4361-88d2-cbbfb98350cb]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_3cetf7bw {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:22 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_3cetf7bw Nov 03 20:24:22 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:22 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_3cetf7bw" returned: 0 in 0.382s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_3cetf7bw {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:22 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_3cetf7bw Nov 03 20:24:22 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] Creating offline snapshot 2b8eba48-077d-460b-aeda-4b43b9407369 of volume f63ed620-39ce-43d8-a604-ab98718123c5 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[287c302d-dc53-42b1-a250-bb349c623d31]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:23 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_3cetf7bw" returned: 1 in 0.367s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_3cetf7bw' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaccd46-cd61-4b5a-b7c0-035f57109730]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:23 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 Nov 03 20:24:23 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:23 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD Nov 03 20:24:23 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:23 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5" returned: 0 in 0.432s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:23 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 1G Nov 03 20:24:23 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:23 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] 82b2f310-b2ab-4d6d-9d32-5c0ace417816 was qcow2, converting to qcow2 {{(pid=87342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:23 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 Nov 03 20:24:23 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:23 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:23 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:24 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 1G" returned: 0 in 0.614s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f63ed620-39ce-43d8-a604-ab98718123c5 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:24 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.395s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:24:24 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f63ed620-39ce-43d8-a604-ab98718123c5 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 Nov 03 20:24:24 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:24 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f63ed620-39ce-43d8-a604-ab98718123c5 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369" returned: 0 in 0.374s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:24 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 is being set with open permissions: ugo+rw Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:24 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 Nov 03 20:24:24 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:24 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369" returned: 0 in 0.293s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=97,cinder:SELECT=87,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:24:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:24 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.info Nov 03 20:24:24 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:25 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.info" returned: 0 in 0.300s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:25 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.info is being set with open permissions: ugo+rw Nov 03 20:24:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:25 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.info Nov 03 20:24:25 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:25 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.info" returned: 0 in 0.297s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b0dfbd45-9cc4-4078-b0bc-e147d1fdc398 tempest-VolumesDeleteCascade-484326236 None] Create snapshot completed successfully Nov 03 20:24:25 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926" returned: 0 in 2.352s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:25 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_21w2cn8ndevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:24:25 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Converted 112.00 MB image at 47.60 MB/s Nov 03 20:24:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:25 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 1G Nov 03 20:24:25 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:26 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 1G" returned: 0 in 0.357s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Downloaded image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 ((None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}])) to volume 3a5ac24c-3704-4cf7-ab93-4aa215781926 successfully. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Temporary image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 for user b439427525c448f29fd160e98a21460e is deleted. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Marking volume 3a5ac24c-3704-4cf7-ab93-4aa215781926 as bootable. {{(pid=87342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Copying metadata from image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 to 3a5ac24c-3704-4cf7-ab93-4aa215781926. {{(pid=87342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Creating volume glance metadata for volume 3a5ac24c-3704-4cf7-ab93-4aa215781926 backed by image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:INSERT=23,cinder:UPDATE=94,cinder:SELECT=85,cinder:DELETE=5 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1916b2ce-06c5-4642-b90a-496be8a8ceff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5ac24c-3704-4cf7-ab93-4aa215781926', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165ccc97-b60d-43c8-a19e-16890ab4089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:26 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Volume volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 (3a5ac24c-3704-4cf7-ab93-4aa215781926): created successfully Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165ccc97-b60d-43c8-a19e-16890ab4089f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Flow 'volume_create_manager' (ce3ffce5-6580-4fc0-9557-97411eb4f696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:26 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4166ce14-aae5-4c10-9cb9-9f673b8e95da tempest-VolumesExtendTest-1439087240 None] Created volume successfully. Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Flow 'volume_create_manager' (cb760ebd-3245-4394-8b21-ce2bdabcd89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be02b41a-46e2-49c9-b725-d07689bba597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be02b41a-46e2-49c9-b725-d07689bba597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-109286521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2604e529-2e1a-4d08-b69d-5834360afe38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9979db02a672402a90678b4e3711315f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2b8eba48-077d-460b-aeda-4b43b9407369,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:27Z,use_quota=True,user_id='381ba8c545e240df88124e69c6d74b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527d693b-e1aa-4216-944b-eee411af7a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527d693b-e1aa-4216-944b-eee411af7a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d97d888-6343-4a56-8177-c7e3c94db006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d97d888-6343-4a56-8177-c7e3c94db006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2604e529-2e1a-4d08-b69d-5834360afe38', 'volume_name': 'volume-2604e529-2e1a-4d08-b69d-5834360afe38', 'volume_size': 1, 'snapshot_id': '2b8eba48-077d-460b-aeda-4b43b9407369'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4512b73-2056-4d5f-8248-f9a8c87b133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4512b73-2056-4d5f-8248-f9a8c87b133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0383c149-d13a-415c-acd6-b7efda103fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:26 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Volume 2604e529-2e1a-4d08-b69d-5834360afe38: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2604e529-2e1a-4d08-b69d-5834360afe38', 'volume_size': 1, 'snapshot_id': '2b8eba48-077d-460b-aeda-4b43b9407369'} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-quobyte-2b8eba48-077d-460b-aeda-4b43b9407369-2604e529-2e1a-4d08-b69d-5834360afe38" by "_create_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-2b8eba48-077d-460b-aeda-4b43b9407369-2604e529-2e1a-4d08-b69d-5834360afe38" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Creating volume 2604e529-2e1a-4d08-b69d-5834360afe38 from snapshot 2b8eba48-077d-460b-aeda-4b43b9407369 {{(pid=87342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-quobyte-2604e529-2e1a-4d08-b69d-5834360afe38" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-2604e529-2e1a-4d08-b69d-5834360afe38" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] snapshot: 2b8eba48-077d-460b-aeda-4b43b9407369, volume: 2604e529-2e1a-4d08-b69d-5834360afe38, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa1ff4f-0b94-4646-ac62-f083452cf1f9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:27 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 Nov 03 20:24:27 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:27 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-99220ec7-8451-4d59-b634-9963d812afb5 tempest-GroupsV320Test-775853388 None] Group tempest-GroupsV320Test-Group-1593682426: creating Nov 03 20:24:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dbaaabcc-8e9f-4cc9-924b-c1f2c1bbf938 tempest-VolumesExtendTest-1439087240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:27 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-99220ec7-8451-4d59-b634-9963d812afb5 tempest-GroupsV320Test-775853388 None] Group tempest-GroupsV320Test-Group-1593682426: created successfully Nov 03 20:24:27 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-99220ec7-8451-4d59-b634-9963d812afb5 tempest-GroupsV320Test-775853388 None] Create group completed successfully. Nov 03 20:24:27 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369" returned: 0 in 0.408s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f63ed620-39ce-43d8-a604-ab98718123c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:24:27 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[817f5f19-5125-4b22-85cb-9237188839c6]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:27 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 Nov 03 20:24:27 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:27 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5" returned: 0 in 0.358s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:24:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:24:27 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38 not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:24:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:27 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38 Nov 03 20:24:27 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:29 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-451a852d-6517-44b9-8daa-26d531110a29 tempest-GroupsV320Test-775853388 None] Created reservations ['4af69e53-d664-45b7-ba11-987079bc4743'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-451a852d-6517-44b9-8daa-26d531110a29 tempest-GroupsV320Test-775853388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-451a852d-6517-44b9-8daa-26d531110a29 tempest-GroupsV320Test-775853388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-451a852d-6517-44b9-8daa-26d531110a29 tempest-GroupsV320Test-775853388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-451a852d-6517-44b9-8daa-26d531110a29 tempest-GroupsV320Test-775853388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-451a852d-6517-44b9-8daa-26d531110a29 tempest-GroupsV320Test-775853388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-451a852d-6517-44b9-8daa-26d531110a29 tempest-GroupsV320Test-775853388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:29 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:29 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:29 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-451a852d-6517-44b9-8daa-26d531110a29 tempest-GroupsV320Test-775853388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.373s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:29 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-451a852d-6517-44b9-8daa-26d531110a29 tempest-GroupsV320Test-775853388 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:29 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-451a852d-6517-44b9-8daa-26d531110a29 tempest-GroupsV320Test-775853388 None] Delete group completed successfully. Nov 03 20:24:34 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38" returned: 0 in 7.027s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:34 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5, size 1024.00 MB, duration 7.03 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:24:34 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Converted 1024.00 MB image at 145.71 MB/s Nov 03 20:24:34 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38 is being set with open permissions: ugo+rw Nov 03 20:24:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:34 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38 Nov 03 20:24:34 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:34 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38" returned: 0 in 0.252s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-2604e529-2e1a-4d08-b69d-5834360afe38" released by "_copy_volume_from_snapshot" :: held 8.145s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-2b8eba48-077d-460b-aeda-4b43b9407369-2604e529-2e1a-4d08-b69d-5834360afe38" released by "_create_volume_from_snapshot" :: held 8.215s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.230s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dbaaabcc-8e9f-4cc9-924b-c1f2c1bbf938 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.878s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0383c149-d13a-415c-acd6-b7efda103fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2604e529-2e1a-4d08-b69d-5834360afe38', 'volume_size': 1, 'snapshot_id': '2b8eba48-077d-460b-aeda-4b43b9407369'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6273ff38-54e1-4e75-a071-68094f8fa011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fe0dbe-59a1-4b49-96b5-6e0c42e71f15]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dbaaabcc-8e9f-4cc9-924b-c1f2c1bbf938 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:35 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Volume volume-2604e529-2e1a-4d08-b69d-5834360afe38 (2604e529-2e1a-4d08-b69d-5834360afe38): created successfully Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6273ff38-54e1-4e75-a071-68094f8fa011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Flow 'volume_create_manager' (cb760ebd-3245-4394-8b21-ce2bdabcd89d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d9a25711-38eb-4754-939f-b9e9e6761dbd tempest-VolumesDeleteCascade-484326236 None] Created volume successfully. Nov 03 20:24:35 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 Nov 03 20:24:35 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:35 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dbaaabcc-8e9f-4cc9-924b-c1f2c1bbf938 tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926" returned: 0 in 0.416s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dbaaabcc-8e9f-4cc9-924b-c1f2c1bbf938 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 2G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-f63ed620-39ce-43d8-a604-ab98718123c5-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-f63ed620-39ce-43d8-a604-ab98718123c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Performing cascade delete. {{(pid=87342) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-2b8eba48-077d-460b-aeda-4b43b9407369-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-2b8eba48-077d-460b-aeda-4b43b9407369-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-quobyte-f63ed620-39ce-43d8-a604-ab98718123c5" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-f63ed620-39ce-43d8-a604-ab98718123c5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-quobyte-2b8eba48-077d-460b-aeda-4b43b9407369" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dbaaabcc-8e9f-4cc9-924b-c1f2c1bbf938 tempest-VolumesExtendTest-1439087240 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 2G" returned: 0 in 0.150s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dbaaabcc-8e9f-4cc9-924b-c1f2c1bbf938 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.608s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-2b8eba48-077d-460b-aeda-4b43b9407369" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Deleting offline snapshot 2b8eba48-077d-460b-aeda-4b43b9407369 of volume f63ed620-39ce-43d8-a604-ab98718123c5 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] snapshot_file for this snap is: volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[487a8ed1-f76c-472a-98c5-071fa335a8a3]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-dbaaabcc-8e9f-4cc9-924b-c1f2c1bbf938 tempest-VolumesExtendTest-1439087240 None] Extend volume completed successfully. Nov 03 20:24:35 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 Nov 03 20:24:35 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:36 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369" returned: 0 in 0.381s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f63ed620-39ce-43d8-a604-ab98718123c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf398a30-b4f8-4933-8f8a-1f9ac3a7f228]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:36 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 Nov 03 20:24:36 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Acquiring lock "cinder-3a5ac24c-3704-4cf7-ab93-4aa215781926-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Lock "cinder-3a5ac24c-3704-4cf7-ab93-4aa215781926-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Acquiring lock "cinder-quobyte-3a5ac24c-3704-4cf7-ab93-4aa215781926" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Lock "cinder-quobyte-3a5ac24c-3704-4cf7-ab93-4aa215781926" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f54eb-789d-4ac5-9016-9fc65bcf97c5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:36 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5" returned: 0 in 0.619s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:36 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 Nov 03 20:24:36 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:36 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 Nov 03 20:24:36 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:37 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926" returned: 0 in 0.396s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:37 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926 Nov 03 20:24:37 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:37 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369" returned: 0 in 0.399s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:37 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369 Nov 03 20:24:37 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:37 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3a5ac24c-3704-4cf7-ab93-4aa215781926" returned: 0 in 0.288s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Lock "cinder-quobyte-3a5ac24c-3704-4cf7-ab93-4aa215781926" released by "delete_volume" :: held 0.747s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:37 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5.2b8eba48-077d-460b-aeda-4b43b9407369" returned: 0 in 0.267s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-2b8eba48-077d-460b-aeda-4b43b9407369" released by "_delete_snapshot" :: held 1.791s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-f63ed620-39ce-43d8-a604-ab98718123c5" released by "delete_snapshot" :: held 1.829s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Created reservations ['726e31a8-e2ac-4aa0-a706-91302180d6d6', 'a7ea0ca0-edd4-4173-98f4-dce711b3a42d', '174ae449-3f92-4c60-b018-34ae24b29fb5', 'eb2c1a2a-b5f9-4b23-a9a9-5880e021abd2'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:37 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:37 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Created reservations ['d8fb1492-e9cc-4c0d-b808-d4e424343d5e', 'b5421e5b-5888-4abc-b758-8cb65bc9bb0f', '5051992e-33de-430c-8ddb-db3d25aac798', '26b87925-db80-4e01-82c2-d35b8ae5e0a8'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Delete snapshot completed successfully. Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-2b8eba48-077d-460b-aeda-4b43b9407369-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Snapshots deleted, issuing volume delete {{(pid=87342) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-quobyte-f63ed620-39ce-43d8-a604-ab98718123c5" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-f63ed620-39ce-43d8-a604-ab98718123c5" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c095cad-9aaf-4de4-8967-7414d3c12ea1]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:37 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 Nov 03 20:24:37 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:37 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.344s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Deleted volume successfully. Nov 03 20:24:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59d7956c-e71b-4752-8f9b-d7a61f5f92e6 tempest-VolumesExtendTest-1439087240 None] Lock "cinder-3a5ac24c-3704-4cf7-ab93-4aa215781926-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:38 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5" returned: 0 in 0.447s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:38 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5 Nov 03 20:24:38 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Flow 'volume_create_manager' (6fe512df-bacf-4150-8a7a-7a1c1a086195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbcc27f-68e1-40df-888c-134cf20d95e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbcc27f-68e1-40df-888c-134cf20d95e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-662905589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c39e186-21e6-452b-ba29-1fbec4cad17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81f4b967fd24586a010cd85bea733e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:38Z,use_quota=True,user_id='b439427525c448f29fd160e98a21460e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc32c1d-f580-4042-9a94-b91e2ebf594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc32c1d-f580-4042-9a94-b91e2ebf594d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5664087-f055-49f6-8756-ffc920e6a526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5664087-f055-49f6-8756-ffc920e6a526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c39e186-21e6-452b-ba29-1fbec4cad17a', 'volume_name': 'volume-9c39e186-21e6-452b-ba29-1fbec4cad17a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeba68bd-c8f0-4f6b-9d63-24ac34aa1820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeba68bd-c8f0-4f6b-9d63-24ac34aa1820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21363748-bf2f-4898-9aa2-da614488bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:38 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Volume 9c39e186-21e6-452b-ba29-1fbec4cad17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c39e186-21e6-452b-ba29-1fbec4cad17a', 'volume_size': 1} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-662905589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c39e186-21e6-452b-ba29-1fbec4cad17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81f4b967fd24586a010cd85bea733e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:38Z,use_quota=True,user_id='b439427525c448f29fd160e98a21460e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Creating volume 9c39e186-21e6-452b-ba29-1fbec4cad17a {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:38 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:38 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a 1073741824 Nov 03 20:24:38 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:38 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f63ed620-39ce-43d8-a604-ab98718123c5" returned: 0 in 0.311s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-f63ed620-39ce-43d8-a604-ab98718123c5" released by "delete_volume" :: held 0.866s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Created reservations ['d0e24a6b-74cc-453f-8fc9-cfd66fa41846', '91b71cee-71b7-4b8b-866d-5a95e5cffc0c', 'b02fb21f-3699-4715-8d1a-bebb6c7b14d8', '2d9044cd-48ac-4e19-bc55-7ebb4d16bbaa'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:38 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:38 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:38 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.303s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:38 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Deleted volume successfully. Nov 03 20:24:38 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a 1073741824" returned: 0 in 0.579s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2310b32-9867-4134-97a6-9692ed48dc2a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-f63ed620-39ce-43d8-a604-ab98718123c5-delete_volume" released by "delete_volume" :: held 3.498s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-2604e529-2e1a-4d08-b69d-5834360afe38-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-2604e529-2e1a-4d08-b69d-5834360afe38-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:39 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a Nov 03 20:24:39 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "cinder-quobyte-2604e529-2e1a-4d08-b69d-5834360afe38" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-2604e529-2e1a-4d08-b69d-5834360afe38" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5426625-ceea-4582-8282-0e1ca3e60617]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:39 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38 Nov 03 20:24:39 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:39 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a" returned: 0 in 0.324s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21363748-bf2f-4898-9aa2-da614488bc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c39e186-21e6-452b-ba29-1fbec4cad17a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f79f3f-0cb6-48dc-b5c7-07fa5081380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:39 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Volume volume-9c39e186-21e6-452b-ba29-1fbec4cad17a (9c39e186-21e6-452b-ba29-1fbec4cad17a): created successfully Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f79f3f-0cb6-48dc-b5c7-07fa5081380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Flow 'volume_create_manager' (6fe512df-bacf-4150-8a7a-7a1c1a086195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e9beb9ed-e925-442d-8567-639c52c8bb82 tempest-VolumesExtendTest-1439087240 None] Created volume successfully. Nov 03 20:24:39 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38" returned: 0 in 0.412s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:39 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38 Nov 03 20:24:39 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:39 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2604e529-2e1a-4d08-b69d-5834360afe38" returned: 0 in 0.266s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-quobyte-2604e529-2e1a-4d08-b69d-5834360afe38" released by "delete_volume" :: held 0.731s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Created reservations ['fe3f4ba6-03e8-4334-9d45-800e24f883d3', '2dc2b59f-659c-4120-8cae-09f6d6e47503', 'e0024caa-6ec1-46bd-8a84-b736a78e96b1', '44af596e-9913-4e29-81ce-cd36221ddd7c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:40 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:40 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:40 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.262s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:40 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Deleted volume successfully. Nov 03 20:24:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8f0f60bb-0614-4a22-9b7b-d1d9601c333a tempest-VolumesDeleteCascade-484326236 None] Lock "cinder-2604e529-2e1a-4d08-b69d-5834360afe38-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] Creating offline snapshot 040d3736-b94c-44b4-a199-a8ba798ef3a9 of volume 9c39e186-21e6-452b-ba29-1fbec4cad17a {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:24:40 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d374b2bd-e8ff-418b-99fe-38fe2c9cc525]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:40 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a Nov 03 20:24:40 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:41 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a" returned: 0 in 0.439s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:41 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 1G Nov 03 20:24:41 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:41 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 1G" returned: 0 in 0.542s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c39e186-21e6-452b-ba29-1fbec4cad17a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:41 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c39e186-21e6-452b-ba29-1fbec4cad17a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 Nov 03 20:24:41 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:41 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c39e186-21e6-452b-ba29-1fbec4cad17a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9" returned: 0 in 0.343s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:41 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 is being set with open permissions: ugo+rw Nov 03 20:24:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:42 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 Nov 03 20:24:42 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:42 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9" returned: 0 in 0.286s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:42 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.info Nov 03 20:24:42 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:42 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.info" returned: 0 in 0.309s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:42 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.info is being set with open permissions: ugo+rw Nov 03 20:24:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:42 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.info Nov 03 20:24:42 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:42 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.info" returned: 0 in 0.320s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-36863fea-6334-4db3-a54f-de6b4f686447 tempest-VolumesExtendTest-1439087240 None] Create snapshot completed successfully Nov 03 20:24:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c88fe03c-23e3-49d5-a9e5-cd052e896970 tempest-VolumesExtendTest-1439087240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c88fe03c-23e3-49d5-a9e5-cd052e896970 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:43 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9a9026-325b-4942-8b20-f54a6fe2917d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c88fe03c-23e3-49d5-a9e5-cd052e896970 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:44 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a Nov 03 20:24:44 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:44 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c88fe03c-23e3-49d5-a9e5-cd052e896970 tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a" returned: 0 in 0.412s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c88fe03c-23e3-49d5-a9e5-cd052e896970 tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 2G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c88fe03c-23e3-49d5-a9e5-cd052e896970 tempest-VolumesExtendTest-1439087240 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 2G" returned: 0 in 0.225s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c88fe03c-23e3-49d5-a9e5-cd052e896970 tempest-VolumesExtendTest-1439087240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.686s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c88fe03c-23e3-49d5-a9e5-cd052e896970 tempest-VolumesExtendTest-1439087240 None] Extend volume completed successfully. Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Flow 'volume_create_manager' (412ba039-58c7-4b67-ba51-5960012810d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce11158-1fe4-4dbd-a24d-9814107abb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce11158-1fe4-4dbd-a24d-9814107abb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-877382630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00568db2-1c92-4c44-99d6-491a562ac4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513cff9278c0460387be81ea343b587a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:45Z,use_quota=True,user_id='113d749cb32641f4a553e2c86808bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546c230e-8ef3-4afa-9bf6-679c8660ceaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546c230e-8ef3-4afa-9bf6-679c8660ceaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18415295-e0ef-447f-a464-dd9c4e6a8be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18415295-e0ef-447f-a464-dd9c4e6a8be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00568db2-1c92-4c44-99d6-491a562ac4bc', 'volume_name': 'volume-00568db2-1c92-4c44-99d6-491a562ac4bc', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bfa6a0-7083-4f6d-9923-96fc6505cae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bfa6a0-7083-4f6d-9923-96fc6505cae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b14ab3-bb99-4b1f-a866-2221a5b4216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:44 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Volume 00568db2-1c92-4c44-99d6-491a562ac4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00568db2-1c92-4c44-99d6-491a562ac4bc', 'volume_size': 1} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-877382630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00568db2-1c92-4c44-99d6-491a562ac4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513cff9278c0460387be81ea343b587a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:45Z,use_quota=True,user_id='113d749cb32641f4a553e2c86808bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Creating volume 00568db2-1c92-4c44-99d6-491a562ac4bc {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:44 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:24:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:44 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc 1073741824 Nov 03 20:24:44 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Acquiring lock "cinder-040d3736-b94c-44b4-a199-a8ba798ef3a9-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Lock "cinder-040d3736-b94c-44b4-a199-a8ba798ef3a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Acquiring lock "cinder-quobyte-9c39e186-21e6-452b-ba29-1fbec4cad17a" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Lock "cinder-quobyte-9c39e186-21e6-452b-ba29-1fbec4cad17a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Acquiring lock "cinder-quobyte-040d3736-b94c-44b4-a199-a8ba798ef3a9" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Lock "cinder-quobyte-040d3736-b94c-44b4-a199-a8ba798ef3a9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Deleting offline snapshot 040d3736-b94c-44b4-a199-a8ba798ef3a9 of volume 9c39e186-21e6-452b-ba29-1fbec4cad17a {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] snapshot_file for this snap is: volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc9647a-4aeb-43c0-9e0b-2fb28c748de2]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:45 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc 1073741824" returned: 0 in 0.550s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:45 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc Nov 03 20:24:45 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:45 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 Nov 03 20:24:45 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:45 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc" returned: 0 in 0.293s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b14ab3-bb99-4b1f-a866-2221a5b4216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00568db2-1c92-4c44-99d6-491a562ac4bc', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb214ed-a5bc-4dfc-93a3-1a62896c5fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:45 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Volume volume-00568db2-1c92-4c44-99d6-491a562ac4bc (00568db2-1c92-4c44-99d6-491a562ac4bc): created successfully Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb214ed-a5bc-4dfc-93a3-1a62896c5fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Flow 'volume_create_manager' (412ba039-58c7-4b67-ba51-5960012810d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a19a16d3-2078-43b4-9b1a-a7cdec618913 tempest-VolumesCloneTest-1891588365 None] Created volume successfully. Nov 03 20:24:45 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9" returned: 0 in 0.424s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c39e186-21e6-452b-ba29-1fbec4cad17a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[511a6241-6681-410a-988e-f9f2e33d22ae]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:45 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a Nov 03 20:24:45 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:46 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a" returned: 0 in 0.371s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:46 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 Nov 03 20:24:46 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Flow 'volume_create_manager' (06938a35-e06f-4ca8-88f3-21403678c601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691e1e62-9ba1-4b89-8bee-a52471a3d621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691e1e62-9ba1-4b89-8bee-a52471a3d621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1729431709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7deb660-187c-4524-9b10-3f81acd56011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e100f13b754244d6a4c029a1d99ba935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:46Z,use_quota=True,user_id='f6a2c16ce2104b718184536d5b77738f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b41c7d-ba06-41b5-b357-a0adde5516ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b41c7d-ba06-41b5-b357-a0adde5516ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079e0b28-c569-4b82-9d65-d3476432d4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079e0b28-c569-4b82-9d65-d3476432d4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7deb660-187c-4524-9b10-3f81acd56011', 'volume_name': 'volume-a7deb660-187c-4524-9b10-3f81acd56011', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cbf928-802b-4106-a13d-fa84d54a73c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cbf928-802b-4106-a13d-fa84d54a73c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c5c970-1615-4352-87a1-779a5d6ad5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:46 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Volume a7deb660-187c-4524-9b10-3f81acd56011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7deb660-187c-4524-9b10-3f81acd56011', 'volume_size': 1} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1729431709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7deb660-187c-4524-9b10-3f81acd56011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e100f13b754244d6a4c029a1d99ba935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:46Z,use_quota=True,user_id='f6a2c16ce2104b718184536d5b77738f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Creating volume a7deb660-187c-4524-9b10-3f81acd56011 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:46 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:46 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011 1073741824 Nov 03 20:24:46 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:46 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9" returned: 0 in 0.430s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:46 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9 Nov 03 20:24:46 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:46 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a.040d3736-b94c-44b4-a199-a8ba798ef3a9" returned: 0 in 0.293s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Lock "cinder-quobyte-040d3736-b94c-44b4-a199-a8ba798ef3a9" released by "_delete_snapshot" :: held 1.661s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Lock "cinder-quobyte-9c39e186-21e6-452b-ba29-1fbec4cad17a" released by "delete_snapshot" :: held 1.692s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:47 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011 1073741824" returned: 0 in 0.546s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Created reservations ['61cb58ba-ffd6-4857-ac5f-f5812d2ef7e5', '15d1536e-dcd3-494e-8ea0-a7360a079e9b', '204be371-7f09-4656-be19-e01776bbd75c', '4b132270-3d53-4e80-9cb8-48f1fdf9f804'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:47 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011 Nov 03 20:24:47 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:47 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Delete snapshot completed successfully. Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-48b0911a-a4ed-47b1-af0a-4a3b8d3176cc tempest-VolumesExtendTest-1439087240 None] Lock "cinder-040d3736-b94c-44b4-a199-a8ba798ef3a9-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:47 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011" returned: 0 in 0.289s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c5c970-1615-4352-87a1-779a5d6ad5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7deb660-187c-4524-9b10-3f81acd56011', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ab038f-08e1-4aae-8cb9-c061d7140adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:47 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Volume volume-a7deb660-187c-4524-9b10-3f81acd56011 (a7deb660-187c-4524-9b10-3f81acd56011): created successfully Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ab038f-08e1-4aae-8cb9-c061d7140adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Flow 'volume_create_manager' (06938a35-e06f-4ca8-88f3-21403678c601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:47 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-3670f2b6-6e88-45ac-9e36-d518fa520b37 tempest-VolumesServicesTestJSON-39536435 None] Created volume successfully. Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Flow 'volume_create_manager' (f108005f-4b08-43ba-80c7-356a11e0b206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dcca04-b77a-4270-9b15-a4c3951cdcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Acquiring lock "cinder-9c39e186-21e6-452b-ba29-1fbec4cad17a-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dcca04-b77a-4270-9b15-a4c3951cdcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-33777283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23671279-0023-49cc-864f-f4335243d3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513cff9278c0460387be81ea343b587a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=00568db2-1c92-4c44-99d6-491a562ac4bc,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:47Z,use_quota=True,user_id='113d749cb32641f4a553e2c86808bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e1bd9b-81e8-489e-b2e6-73f3dab2a3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e1bd9b-81e8-489e-b2e6-73f3dab2a3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ba6f12-df6d-4fec-852c-5a9c9a1f6516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Lock "cinder-9c39e186-21e6-452b-ba29-1fbec4cad17a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ba6f12-df6d-4fec-852c-5a9c9a1f6516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '23671279-0023-49cc-864f-f4335243d3d4', 'volume_name': 'volume-23671279-0023-49cc-864f-f4335243d3d4', 'volume_size': 2, 'source_volid': '00568db2-1c92-4c44-99d6-491a562ac4bc', 'source_volstatus': 'available'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38736c49-acd3-4727-a0b2-5c16f042e67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38736c49-acd3-4727-a0b2-5c16f042e67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e29d47-96c3-48dc-91c2-fc64dcc40eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:47 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Volume 23671279-0023-49cc-864f-f4335243d3d4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-23671279-0023-49cc-864f-f4335243d3d4', 'volume_size': 2, 'source_volid': '00568db2-1c92-4c44-99d6-491a562ac4bc', 'source_volstatus': 'available'} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:47 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Cloning volume 00568db2-1c92-4c44-99d6-491a562ac4bc to volume 23671279-0023-49cc-864f-f4335243d3d4 Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Acquiring lock "cinder-quobyte-9c39e186-21e6-452b-ba29-1fbec4cad17a" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Creating offline snapshot dcafbd92-563c-461d-82cd-023e5e465b08 of volume 00568db2-1c92-4c44-99d6-491a562ac4bc {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Lock "cinder-quobyte-9c39e186-21e6-452b-ba29-1fbec4cad17a" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f552fdb6-ae0a-451b-a48f-49278ac869a8]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1089bed-ec8e-47fc-b521-31ee816dace1]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:47 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc Nov 03 20:24:47 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:47 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a Nov 03 20:24:47 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:48 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc" returned: 0 in 0.377s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:48 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a" returned: 0 in 0.375s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:48 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 1G Nov 03 20:24:48 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:48 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a Nov 03 20:24:48 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:48 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39e186-21e6-452b-ba29-1fbec4cad17a" returned: 0 in 0.246s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Lock "cinder-quobyte-9c39e186-21e6-452b-ba29-1fbec4cad17a" released by "delete_volume" :: held 0.693s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Created reservations ['b65d5dc9-e965-4092-9bb7-2d0cad6157aa', '5c841c33-4fd3-44a4-9018-2a9381bd7af4', '409594ed-a188-437a-b62c-f2a876e32979', 'd025cb10-adf6-46bc-832b-e3b393c01da4'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:48 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 1G" returned: 0 in 0.457s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00568db2-1c92-4c44-99d6-491a562ac4bc -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:48 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:48 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:48 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00568db2-1c92-4c44-99d6-491a562ac4bc -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 Nov 03 20:24:48 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Acquiring lock "cinder-a7deb660-187c-4524-9b10-3f81acd56011-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Lock "cinder-a7deb660-187c-4524-9b10-3f81acd56011-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:48 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.293s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:48 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Deleted volume successfully. Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8c541730-6ecc-4305-be2a-fc929dd466ea tempest-VolumesExtendTest-1439087240 None] Lock "cinder-9c39e186-21e6-452b-ba29-1fbec4cad17a-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Acquiring lock "cinder-quobyte-a7deb660-187c-4524-9b10-3f81acd56011" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Lock "cinder-quobyte-a7deb660-187c-4524-9b10-3f81acd56011" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[af214519-bf58-407a-bbaf-8d4681fe2981]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:48 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00568db2-1c92-4c44-99d6-491a562ac4bc -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08" returned: 0 in 0.384s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:48 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 is being set with open permissions: ugo+rw Nov 03 20:24:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:48 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 Nov 03 20:24:48 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:48 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011 Nov 03 20:24:48 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:49 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08" returned: 0 in 0.266s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:49 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.info Nov 03 20:24:49 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:49 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011" returned: 0 in 0.399s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:49 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011 Nov 03 20:24:49 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:49 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.info" returned: 0 in 0.287s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:49 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.info is being set with open permissions: ugo+rw Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:49 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.info Nov 03 20:24:49 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:49 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7deb660-187c-4524-9b10-3f81acd56011" returned: 0 in 0.286s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Lock "cinder-quobyte-a7deb660-187c-4524-9b10-3f81acd56011" released by "delete_volume" :: held 0.739s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Created reservations ['2c9da913-83ee-4ede-98b0-1980379edce6', '50d878f4-9928-4f6f-af21-9f96e1b3bd2a', '09416e78-9591-4f0d-9408-186d982f3c35', '43cd8de0-d1f4-49af-9b21-f70fcddf5170'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:49 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:49 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:24:49 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.info" returned: 0 in 0.278s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Acquiring lock "cinder-quobyte-23671279-0023-49cc-864f-f4335243d3d4" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Lock "cinder-quobyte-23671279-0023-49cc-864f-f4335243d3d4" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] snapshot: dcafbd92-563c-461d-82cd-023e5e465b08, volume: 23671279-0023-49cc-864f-f4335243d3d4, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e767b2ab-9652-47e1-aede-e9f58ea467f2]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:50 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 Nov 03 20:24:50 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:50 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.325s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:50 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Deleted volume successfully. Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-85ff3094-544d-4f93-b761-cb543da3bb97 tempest-VolumesServicesTestJSON-39536435 None] Lock "cinder-a7deb660-187c-4524-9b10-3f81acd56011-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:50 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08" returned: 0 in 0.514s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00568db2-1c92-4c44-99d6-491a562ac4bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a597097f-0e93-477a-bb48-207c36a36704]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:50 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc Nov 03 20:24:50 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:50 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc" returned: 0 in 0.428s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4 not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:24:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:50 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4 Nov 03 20:24:50 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:59 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4" returned: 0 in 8.172s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc, size 1024.00 MB, duration 8.17 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:24:59 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Converted 1024.00 MB image at 125.28 MB/s Nov 03 20:24:59 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4 is being set with open permissions: ugo+rw Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:59 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4 Nov 03 20:24:59 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:59 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4" returned: 0 in 0.272s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Lock "cinder-quobyte-23671279-0023-49cc-864f-f4335243d3d4" released by "_copy_volume_from_snapshot" :: held 9.517s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Acquiring lock "cinder-quobyte-dcafbd92-563c-461d-82cd-023e5e465b08" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Lock "cinder-quobyte-dcafbd92-563c-461d-82cd-023e5e465b08" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Deleting offline snapshot dcafbd92-563c-461d-82cd-023e5e465b08 of volume 00568db2-1c92-4c44-99d6-491a562ac4bc {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] snapshot_file for this snap is: volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7540f8b4-f535-4330-b40a-8af857f79f63]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:59 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 Nov 03 20:24:59 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=74,cinder:UPDATE=81,cinder:DELETE=6,cinder:INSERT=22 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:24:59 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08" returned: 0 in 0.468s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00568db2-1c92-4c44-99d6-491a562ac4bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[593121cb-9da7-4b9c-bc20-e33a22187cac]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:00 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc Nov 03 20:25:00 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Flow 'volume_create_manager' (be031f55-f7d1-4425-878f-01fd6d9a193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4256281-7f5c-49f0-a98f-0e2ad4202063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4256281-7f5c-49f0-a98f-0e2ad4202063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1841996472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8339c0-77fa-451e-aa32-ba39f1bbd5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681cef3dd820456185a325a9da984676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:00Z,use_quota=True,user_id='07a4f1edd2264d078272e21c632b5642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb9678b6-49a4-4fc4-8265-8dfc2cdba986),volume_type_id=fb9678b6-49a4-4fc4-8265-8dfc2cdba986)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0fde49d-dc4f-4175-89af-592aa14bdd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0fde49d-dc4f-4175-89af-592aa14bdd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31390032-85f7-4233-8a89-3a9eccbed806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31390032-85f7-4233-8a89-3a9eccbed806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef8339c0-77fa-451e-aa32-ba39f1bbd5cc', 'volume_name': 'volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac38a5e-5dd3-4a57-a018-762623ae87c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac38a5e-5dd3-4a57-a018-762623ae87c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839ec768-e2d7-4e5f-bfef-75ba3f2519a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:00 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Volume ef8339c0-77fa-451e-aa32-ba39f1bbd5cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc', 'volume_size': 1} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:00 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc" returned: 0 in 0.624s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:00 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 Nov 03 20:25:00 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:01 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08" returned: 0 in 0.421s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:01 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08 Nov 03 20:25:01 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:01 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc.dcafbd92-563c-461d-82cd-023e5e465b08" returned: 0 in 0.269s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Lock "cinder-quobyte-dcafbd92-563c-461d-82cd-023e5e465b08" released by "_delete_snapshot" :: held 1.950s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.771s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1841996472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8339c0-77fa-451e-aa32-ba39f1bbd5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681cef3dd820456185a325a9da984676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:00Z,use_quota=True,user_id='07a4f1edd2264d078272e21c632b5642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb9678b6-49a4-4fc4-8265-8dfc2cdba986),volume_type_id=fb9678b6-49a4-4fc4-8265-8dfc2cdba986)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Creating volume ef8339c0-77fa-451e-aa32-ba39f1bbd5cc {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:01 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e29d47-96c3-48dc-91c2-fc64dcc40eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23671279-0023-49cc-864f-f4335243d3d4', 'volume_size': 2, 'source_volid': '00568db2-1c92-4c44-99d6-491a562ac4bc', 'source_volstatus': 'available'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1512818d-bf09-48b8-b814-081aea728f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:01 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc 1073741824 Nov 03 20:25:01 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:01 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Volume volume-23671279-0023-49cc-864f-f4335243d3d4 (23671279-0023-49cc-864f-f4335243d3d4): created successfully Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1512818d-bf09-48b8-b814-081aea728f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Flow 'volume_create_manager' (f108005f-4b08-43ba-80c7-356a11e0b206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:01 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ad3882df-a56b-4cbf-8bfd-ad627660d12a tempest-VolumesCloneTest-1891588365 None] Created volume successfully. Nov 03 20:25:01 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc 1073741824" returned: 0 in 0.572s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:02 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc Nov 03 20:25:02 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Acquiring lock "cinder-23671279-0023-49cc-864f-f4335243d3d4-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:02 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Lock "cinder-23671279-0023-49cc-864f-f4335243d3d4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc" returned: 0 in 0.314s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839ec768-e2d7-4e5f-bfef-75ba3f2519a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8122d480-7717-4219-b928-cf7fe29e9030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:02 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Volume volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc (ef8339c0-77fa-451e-aa32-ba39f1bbd5cc): created successfully Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8122d480-7717-4219-b928-cf7fe29e9030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Flow 'volume_create_manager' (be031f55-f7d1-4425-878f-01fd6d9a193f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Acquiring lock "cinder-quobyte-23671279-0023-49cc-864f-f4335243d3d4" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:02 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4028efb5-7eb2-45ac-a01b-be6ea3f18440 tempest-VolumeTypesAccessTest-177666804 None] Created volume successfully. Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Lock "cinder-quobyte-23671279-0023-49cc-864f-f4335243d3d4" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c42000-db55-4088-8fbd-d3f9663befcf]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:02 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4 Nov 03 20:25:02 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Acquiring lock "cinder-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Lock "cinder-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Acquiring lock "cinder-quobyte-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Lock "cinder-quobyte-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc" acquired by "delete_volume" :: waited 0.041s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[379a7634-ac78-423a-99e1-b54e964d24a8]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:03 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc Nov 03 20:25:03 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:03 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4" returned: 0 in 0.716s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:03 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4 Nov 03 20:25:03 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:03 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-23671279-0023-49cc-864f-f4335243d3d4" returned: 0 in 0.337s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Lock "cinder-quobyte-23671279-0023-49cc-864f-f4335243d3d4" released by "delete_volume" :: held 1.114s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:03 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc" returned: 0 in 0.538s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:03 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc Nov 03 20:25:03 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Created reservations ['a48f62ef-6229-4a91-a7bd-4f657cea2661', '7819e928-df7a-47eb-bb46-34d1d0265703', '053cb241-430d-4f8c-8bae-078214887f67', '2b0ace78-8475-42ec-a65e-c1ede9a1857c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:03 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:25:03 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:03 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc" returned: 0 in 0.320s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Lock "cinder-quobyte-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc" released by "delete_volume" :: held 0.924s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:03 devstack cinder-volume[87342]: WARNING cinder.quota [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-848715604 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-848715604, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:25:03 devstack cinder-volume[87342]: WARNING cinder.quota [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-848715604 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-848715604, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Created reservations ['d6341dd9-d0e1-4127-8617-8df6a71166fc', '70cedee4-cc21-478c-acc4-cf8409d74727', '240d31c7-f546-499d-b76b-6d29e2abfcae', 'd8571377-f0ed-47bd-891b-af9ba4017275'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:04 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:25:04 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:04 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.347s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Deleted volume successfully. Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e148cde6-9342-4293-8b38-fd032047454a tempest-VolumesCloneTest-1891588365 None] Lock "cinder-23671279-0023-49cc-864f-f4335243d3d4-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:04 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.323s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Deleted volume successfully. Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9b44f54c-a126-4ae5-9f7f-e439078c96a7 tempest-VolumeTypesAccessTest-177666804 None] Lock "cinder-ef8339c0-77fa-451e-aa32-ba39f1bbd5cc-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Acquiring lock "cinder-00568db2-1c92-4c44-99d6-491a562ac4bc-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Lock "cinder-00568db2-1c92-4c44-99d6-491a562ac4bc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Acquiring lock "cinder-quobyte-00568db2-1c92-4c44-99d6-491a562ac4bc" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Lock "cinder-quobyte-00568db2-1c92-4c44-99d6-491a562ac4bc" acquired by "delete_volume" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2644fb8-c27f-4c1e-994b-f6539c7dd8a0]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:05 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc Nov 03 20:25:05 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:05 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc" returned: 0 in 0.475s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:05 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc Nov 03 20:25:05 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:05 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-00568db2-1c92-4c44-99d6-491a562ac4bc" returned: 0 in 0.324s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Lock "cinder-quobyte-00568db2-1c92-4c44-99d6-491a562ac4bc" released by "delete_volume" :: held 0.911s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:05 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Created reservations ['43dd4953-a714-4dcb-91e5-d8ef9a3785a1', 'b5247b88-93e4-4e65-8660-c30ca52b8887', '2acd88d5-d975-4fe6-a387-94cfb47c1df1', '44cb89fc-00e6-471f-b6b9-464e0e0e9c19'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:05 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:25:05 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:06 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:06 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:06 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Deleted volume successfully. Nov 03 20:25:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c69f9e8d-e142-4caa-847b-f962c9018897 tempest-VolumesCloneTest-1891588365 None] Lock "cinder-00568db2-1c92-4c44-99d6-491a562ac4bc-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:15 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:INSERT=34,cinder:SELECT=81,cinder:UPDATE=107,cinder:DELETE=9 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=19,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Flow 'volume_create_manager' (01f53c01-ccbb-42c8-bbda-06ccb2a5fe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6001d75f-6ad2-43ee-b95c-2fca89c2c6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6001d75f-6ad2-43ee-b95c-2fca89c2c6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-608047521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d67c3123994486ad0443b7fc13d0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:17Z,use_quota=True,user_id='d27fe7d7389942d482c715c128faf8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f14aa7-972a-47fa-8306-e079520efd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f14aa7-972a-47fa-8306-e079520efd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d9a944-06f6-4000-8493-1f0e6557bc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d9a944-06f6-4000-8493-1f0e6557bc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6', 'volume_name': 'volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a7174b-840c-4d4a-b63b-523158ef5c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a7174b-840c-4d4a-b63b-523158ef5c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac13910-8d60-48c5-9855-11bfeb59b585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:16 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Volume c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6', 'volume_size': 1} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-608047521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d67c3123994486ad0443b7fc13d0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:17Z,use_quota=True,user_id='d27fe7d7389942d482c715c128faf8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Creating volume c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:16 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:25:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:17 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6 1073741824 Nov 03 20:25:17 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Flow 'volume_create_manager' (5fa8482d-6157-4053-bbd2-09f041064ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f007f714-b27b-42a6-866c-4ca0335c8ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f007f714-b27b-42a6-866c-4ca0335c8ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-740419761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599383d7-9c4d-4f34-9057-408924cbec03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d67c3123994486ad0443b7fc13d0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:17Z,use_quota=True,user_id='d27fe7d7389942d482c715c128faf8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcafcb19-fe32-4d6c-8383-edc4eb5c6a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcafcb19-fe32-4d6c-8383-edc4eb5c6a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d70eed-52a9-4719-b4e2-377a619c0b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d70eed-52a9-4719-b4e2-377a619c0b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '599383d7-9c4d-4f34-9057-408924cbec03', 'volume_name': 'volume-599383d7-9c4d-4f34-9057-408924cbec03', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36f195a-319e-40de-8d05-568bf72e16a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36f195a-319e-40de-8d05-568bf72e16a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6196d3-a3cb-4f8d-a519-e70493be7362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:17 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Volume 599383d7-9c4d-4f34-9057-408924cbec03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-599383d7-9c4d-4f34-9057-408924cbec03', 'volume_size': 1} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:17 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6 1073741824" returned: 0 in 0.857s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-e8c2dabf-6a11-4e41-8910-c65e89e7f143 req-dc901e31-ed9d-42e1-a6e6-47efdc42c154 tempest-ServerActionsTestOtherA-501095522 None] Terminate volume connection completed successfully. Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-e8c2dabf-6a11-4e41-8910-c65e89e7f143 req-dc901e31-ed9d-42e1-a6e6-47efdc42c154 tempest-ServerActionsTestOtherA-501095522 None] Deleting attachment a3050a5a-c25c-4f29-b799-e362ac74685f. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:25:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:17 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6 Nov 03 20:25:17 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:18 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6" returned: 0 in 0.392s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-740419761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599383d7-9c4d-4f34-9057-408924cbec03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d67c3123994486ad0443b7fc13d0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:17Z,use_quota=True,user_id='d27fe7d7389942d482c715c128faf8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Creating volume 599383d7-9c4d-4f34-9057-408924cbec03 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:18 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac13910-8d60-48c5-9855-11bfeb59b585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee066649-96af-4748-a60e-9f6a58fb5582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:18 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03 1073741824 Nov 03 20:25:18 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:18 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Volume volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6 (c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6): created successfully Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee066649-96af-4748-a60e-9f6a58fb5582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Flow 'volume_create_manager' (01f53c01-ccbb-42c8-bbda-06ccb2a5fe71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:18 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-03afac9a-8aef-45e7-9796-caf3fefe702c tempest-TestServerVolumeAttachmentScenario-1159376168 None] Created volume successfully. Nov 03 20:25:18 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03 1073741824" returned: 0 in 0.649s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:19 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03 Nov 03 20:25:19 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:19 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03" returned: 0 in 0.314s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6196d3-a3cb-4f8d-a519-e70493be7362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599383d7-9c4d-4f34-9057-408924cbec03', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5635bd4-b098-4d78-8bb8-5bf0c62b4460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Volume volume-599383d7-9c4d-4f34-9057-408924cbec03 (599383d7-9c4d-4f34-9057-408924cbec03): created successfully Nov 03 20:25:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5635bd4-b098-4d78-8bb8-5bf0c62b4460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Flow 'volume_create_manager' (5fa8482d-6157-4053-bbd2-09f041064ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:19 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-656d1911-10f9-44ca-8702-54b7ecc3139d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Created volume successfully. Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Flow 'volume_create_manager' (1afc4be7-6703-49ba-a923-dc245f778864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824a4caa-157d-44c3-a209-3571a58dd690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824a4caa-157d-44c3-a209-3571a58dd690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-535359859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a92c1d4-ab36-4152-b375-1234b20e15ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c0ba5ba6474e3dbddf4b4778d27966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:20Z,use_quota=True,user_id='9024f091817044b1819851b0fc3a78d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e62e5a-2fbe-4199-8db3-21abb32a4322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e62e5a-2fbe-4199-8db3-21abb32a4322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0acd07a-4222-454a-a550-153bb2476b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.image.glance [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Creating Keystone auth plugin from conf {{(pid=87342) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0acd07a-4222-454a-a550-153bb2476b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a92c1d4-ab36-4152-b375-1234b20e15ee', 'volume_name': 'volume-6a92c1d4-ab36-4152-b375-1234b20e15ee', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cde9b4-389b-44c8-89d6-1fdc12ceed67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cde9b4-389b-44c8-89d6-1fdc12ceed67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5efdb90-1fd3-4b40-bf0f-ef2ea4a08d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:20 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Volume 6a92c1d4-ab36-4152-b375-1234b20e15ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a92c1d4-ab36-4152-b375-1234b20e15ee', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Trying to clone 6a92c1d4-ab36-4152-b375-1234b20e15ee from image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 at location (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]). {{(pid=87342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:25:20 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Image download 20.69 MB at 20.69 MB/s Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[862696e5-e810-4d2f-badc-f80f2216d747]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:20 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD Nov 03 20:25:20 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:21 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Temporary image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 is fetched for user 9024f091817044b1819851b0fc3a78d9. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7641276-a925-4c12-803b-5e1c41460a49]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:21 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD Nov 03 20:25:21 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:21 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-535359859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a92c1d4-ab36-4152-b375-1234b20e15ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c0ba5ba6474e3dbddf4b4778d27966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:20Z,use_quota=True,user_id='9024f091817044b1819851b0fc3a78d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Creating volume 6a92c1d4-ab36-4152-b375-1234b20e15ee {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:21 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:25:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:21 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee 1073741824 Nov 03 20:25:21 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:22 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee 1073741824" returned: 0 in 0.510s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:22 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee Nov 03 20:25:22 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:22 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee" returned: 0 in 0.372s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:22 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Attempting download of 82b2f310-b2ab-4d6d-9d32-5c0ace417816 ((None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}])) to volume 6a92c1d4-ab36-4152-b375-1234b20e15ee. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:25:22 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d8911e-0e17-411d-a69b-07763129291f]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_rp5o_dws {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:22 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_rp5o_dws Nov 03 20:25:22 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:23 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_rp5o_dws" returned: 0 in 0.357s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_rp5o_dws {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:23 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_rp5o_dws Nov 03 20:25:23 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:23 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_rp5o_dws" returned: 1 in 0.426s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_rp5o_dws' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a2c8de-fc05-4b07-ad54-4ea8ca732cf9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:23 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:25:23 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:23 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD Nov 03 20:25:23 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:24 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:24 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.455s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] 82b2f310-b2ab-4d6d-9d32-5c0ace417816 was qcow2, converting to qcow2 {{(pid=87342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:25:24 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee Nov 03 20:25:24 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Flow 'volume_create_manager' (c337124c-1a8a-4ba1-92c3-1379b96809f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed32247-71c2-45b1-a9f6-f58172ed9e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed32247-71c2-45b1-a9f6-f58172ed9e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-508948494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f302d9-cbee-454f-81ee-93682e0c0295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241a899848db4305b08efc0b56f5debf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:25Z,use_quota=True,user_id='a2cab4195cb148bda9c19093d58d160b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d6699f-b612-4022-a721-9c8dbdc0a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d6699f-b612-4022-a721-9c8dbdc0a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155e10e3-cc3d-41f6-bddb-cc660d7ea449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:24 devstack cinder-volume[87342]: DEBUG cinder.image.glance [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Creating Keystone auth plugin from conf {{(pid=87342) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:25:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155e10e3-cc3d-41f6-bddb-cc660d7ea449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93f302d9-cbee-454f-81ee-93682e0c0295', 'volume_name': 'volume-93f302d9-cbee-454f-81ee-93682e0c0295', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25a8ed0-58ef-45a7-aa44-6483655e24b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25a8ed0-58ef-45a7-aa44-6483655e24b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cb6ebd-f1c5-47d2-8852-1d93a371dfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:25 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Volume 93f302d9-cbee-454f-81ee-93682e0c0295: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93f302d9-cbee-454f-81ee-93682e0c0295', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 20:25:25 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Trying to clone 93f302d9-cbee-454f-81ee-93682e0c0295 from image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 at location (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]). {{(pid=87342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:25:26 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:25:26 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Image download 20.69 MB at 20.69 MB/s Nov 03 20:25:26 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8c3adc-f882-4c46-9fc5-b3d0f4aac98a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:26 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD Nov 03 20:25:26 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:26 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD" returned: 0 in 0.590s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:26 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Temporary image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 is fetched for user a2cab4195cb148bda9c19093d58d160b. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:25:26 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ccb108-e0b9-4c26-a77b-dd21d91ab222]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Flow 'volume_create_manager' (9473362e-cd77-43d6-8529-4a9c55f70025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff221038-26d3-4197-ab17-bcb94145c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff221038-26d3-4197-ab17-bcb94145c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1553322366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56642f04-8e43-40f9-95e7-8d4ef2efd061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de886c54370a44798ccba24aa6a7816c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:27Z,use_quota=True,user_id='ab05589aa3ea43dca0f7744a111ac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fd763b-929c-4120-8fe3-1a5850e1b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fd763b-929c-4120-8fe3-1a5850e1b05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0d3526-5b58-41d9-9155-3b270acb204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:27 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD Nov 03 20:25:27 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0d3526-5b58-41d9-9155-3b270acb204d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56642f04-8e43-40f9-95e7-8d4ef2efd061', 'volume_name': 'volume-56642f04-8e43-40f9-95e7-8d4ef2efd061', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:27 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c5e237-1b8c-4388-9764-88063cdd4d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c5e237-1b8c-4388-9764-88063cdd4d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96eb372-79d4-4028-a361-9e0990be1a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:27 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Volume 56642f04-8e43-40f9-95e7-8d4ef2efd061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56642f04-8e43-40f9-95e7-8d4ef2efd061', 'volume_size': 1} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1553322366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56642f04-8e43-40f9-95e7-8d4ef2efd061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de886c54370a44798ccba24aa6a7816c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:27Z,use_quota=True,user_id='ab05589aa3ea43dca0f7744a111ac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Creating volume 56642f04-8e43-40f9-95e7-8d4ef2efd061 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:27 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee" returned: 0 in 3.102s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_7iv_tdxfdevstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:25:27 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Converted 112.00 MB image at 36.08 MB/s Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:27 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 1073741824 Nov 03 20:25:27 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:27 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee 1G Nov 03 20:25:27 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:27 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:27 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee 1G" returned: 0 in 0.483s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Downloaded image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 ((None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}])) to volume 6a92c1d4-ab36-4152-b375-1234b20e15ee successfully. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Temporary image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 for user 9024f091817044b1819851b0fc3a78d9 is deleted. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Marking volume 6a92c1d4-ab36-4152-b375-1234b20e15ee as bootable. {{(pid=87342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Copying metadata from image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 to 6a92c1d4-ab36-4152-b375-1234b20e15ee. {{(pid=87342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Creating volume glance metadata for volume 6a92c1d4-ab36-4152-b375-1234b20e15ee backed by image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5efdb90-1fd3-4b40-bf0f-ef2ea4a08d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a92c1d4-ab36-4152-b375-1234b20e15ee', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4e818f-22c0-4ce5-b6af-abc686359e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:27 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Volume volume-6a92c1d4-ab36-4152-b375-1234b20e15ee (6a92c1d4-ab36-4152-b375-1234b20e15ee): created successfully Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4e818f-22c0-4ce5-b6af-abc686359e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Flow 'volume_create_manager' (1afc4be7-6703-49ba-a923-dc245f778864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:27 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-828fd12b-5fc0-4bc0-9e01-ed1685e290ca tempest-VolumesImageMetadata-1362393204 None] Created volume successfully. Nov 03 20:25:27 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 1073741824" returned: 0 in 0.756s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:28 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 Nov 03 20:25:28 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:28 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061" returned: 0 in 0.268s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-508948494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f302d9-cbee-454f-81ee-93682e0c0295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241a899848db4305b08efc0b56f5debf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:25Z,use_quota=True,user_id='a2cab4195cb148bda9c19093d58d160b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Creating volume 93f302d9-cbee-454f-81ee-93682e0c0295 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:28 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96eb372-79d4-4028-a361-9e0990be1a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56642f04-8e43-40f9-95e7-8d4ef2efd061', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:28 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 1073741824 Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43319e9-c3a4-4734-80cc-98cb60034afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:28 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:28 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Volume volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 (56642f04-8e43-40f9-95e7-8d4ef2efd061): created successfully Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43319e9-c3a4-4734-80cc-98cb60034afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Flow 'volume_create_manager' (9473362e-cd77-43d6-8529-4a9c55f70025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:28 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a3274ab5-9961-44bb-b631-9bae1303b94a tempest-VolumesSnapshotTestJSON-1960482620 None] Created volume successfully. Nov 03 20:25:28 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 1073741824" returned: 0 in 0.535s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:28 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 Nov 03 20:25:28 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:29 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295" returned: 0 in 0.328s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Attempting download of 82b2f310-b2ab-4d6d-9d32-5c0ace417816 ((None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}])) to volume 93f302d9-cbee-454f-81ee-93682e0c0295. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6cc849-18fc-45fe-a175-923e8d6488d0]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_b0vv5p68 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Acquiring lock "cinder-6a92c1d4-ab36-4152-b375-1234b20e15ee-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Lock "cinder-6a92c1d4-ab36-4152-b375-1234b20e15ee-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:29 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_b0vv5p68 Nov 03 20:25:29 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Acquiring lock "cinder-quobyte-6a92c1d4-ab36-4152-b375-1234b20e15ee" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] Creating offline snapshot a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 of volume 56642f04-8e43-40f9-95e7-8d4ef2efd061 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Lock "cinder-quobyte-6a92c1d4-ab36-4152-b375-1234b20e15ee" acquired by "delete_volume" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1d972e-6e22-4aa7-a251-d54c4c5296c0]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42a2a9f-023d-48c5-b663-ca5a132db0d5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:29 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_b0vv5p68" returned: 0 in 0.486s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_b0vv5p68 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:29 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 Nov 03 20:25:29 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:29 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee Nov 03 20:25:29 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:29 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_b0vv5p68 Nov 03 20:25:29 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061" returned: 0 in 0.498s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:30 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:30 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee" returned: 0 in 0.535s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:30 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 1G Nov 03 20:25:30 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:30 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_b0vv5p68" returned: 1 in 0.498s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:30 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_b0vv5p68' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:25:30 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f11903-e028-4c78-af28-ed2fc5494788]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:30 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD Nov 03 20:25:30 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:30 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6a92c1d4-ab36-4152-b375-1234b20e15ee" returned: 0 in 0.582s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Lock "cinder-quobyte-6a92c1d4-ab36-4152-b375-1234b20e15ee" released by "delete_volume" :: held 1.198s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:30 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD" returned: 0 in 0.627s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] 82b2f310-b2ab-4d6d-9d32-5c0ace417816 was qcow2, converting to qcow2 {{(pid=87342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:25:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:31 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 Nov 03 20:25:31 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Created reservations ['39803740-d070-4e85-ac1f-562f15b4ad73', '4f661220-c496-4d5b-9b42-bc2002cc7dee', 'be9940a5-f353-44f5-8449-610798f1862b', '04f44d3d-e4d2-48fc-8b99-c015d88462d3'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:31 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:25:31 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:31 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 1G" returned: 0 in 1.294s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:31 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 Nov 03 20:25:31 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:31 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.605s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:31 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Deleted volume successfully. Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77c81446-5024-4286-83b7-20f39dc06cc9 tempest-VolumesImageMetadata-1362393204 None] Lock "cinder-6a92c1d4-ab36-4152-b375-1234b20e15ee-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:31 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0" returned: 0 in 0.528s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:31 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 is being set with open permissions: ugo+rw Nov 03 20:25:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:32 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 Nov 03 20:25:32 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0" returned: 0 in 0.452s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:32 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:32 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.info Nov 03 20:25:32 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:33 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.info" returned: 0 in 0.504s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:33 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.info is being set with open permissions: ugo+rw Nov 03 20:25:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:33 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.info Nov 03 20:25:33 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:33 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.info" returned: 0 in 0.447s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.997s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:33 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-30b10252-5dca-4503-a115-1fc36511810c tempest-VolumesSnapshotTestJSON-1960482620 None] Create snapshot completed successfully Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-a4ae9f42-bf54-40ea-b79c-37d87bc48ea0-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-a4ae9f42-bf54-40ea-b79c-37d87bc48ea0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-56642f04-8e43-40f9-95e7-8d4ef2efd061" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-56642f04-8e43-40f9-95e7-8d4ef2efd061" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-a4ae9f42-bf54-40ea-b79c-37d87bc48ea0" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-a4ae9f42-bf54-40ea-b79c-37d87bc48ea0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Deleting offline snapshot a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 of volume 56642f04-8e43-40f9-95e7-8d4ef2efd061 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] snapshot_file for this snap is: volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5354bdb-410d-4d05-8124-746786a0bab9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:34 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295" returned: 0 in 3.481s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_bkyqsm2ddevstack@QuobyteHD, size 112.00 MB, duration 3.48 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:25:34 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Converted 112.00 MB image at 32.15 MB/s Nov 03 20:25:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:34 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 1G Nov 03 20:25:34 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:34 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 Nov 03 20:25:34 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:35 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 1G" returned: 0 in 0.593s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Downloaded image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 ((None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}])) to volume 93f302d9-cbee-454f-81ee-93682e0c0295 successfully. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Temporary image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 for user a2cab4195cb148bda9c19093d58d160b is deleted. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Marking volume 93f302d9-cbee-454f-81ee-93682e0c0295 as bootable. {{(pid=87342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Copying metadata from image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 to 93f302d9-cbee-454f-81ee-93682e0c0295. {{(pid=87342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Creating volume glance metadata for volume 93f302d9-cbee-454f-81ee-93682e0c0295 backed by image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:25:35 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0" returned: 0 in 0.727s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56642f04-8e43-40f9-95e7-8d4ef2efd061(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dce924e-6bd3-4fb8-b275-7833d94f7452]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cb6ebd-f1c5-47d2-8852-1d93a371dfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93f302d9-cbee-454f-81ee-93682e0c0295', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdba81fc-1642-4d1b-b898-6a9b924c6b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:35 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Volume volume-93f302d9-cbee-454f-81ee-93682e0c0295 (93f302d9-cbee-454f-81ee-93682e0c0295): created successfully Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdba81fc-1642-4d1b-b898-6a9b924c6b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Flow 'volume_create_manager' (c337124c-1a8a-4ba1-92c3-1379b96809f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f54da7b9-4d6b-4197-836b-043b0c567c5d tempest-ServerActionsTestOtherA-501095522 None] Created volume successfully. Nov 03 20:25:35 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 Nov 03 20:25:35 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:35 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061" returned: 0 in 0.633s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:35 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 Nov 03 20:25:35 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:36 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0" returned: 0 in 0.480s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:36 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0 Nov 03 20:25:36 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:36 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061.a4ae9f42-bf54-40ea-b79c-37d87bc48ea0" returned: 0 in 0.482s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-a4ae9f42-bf54-40ea-b79c-37d87bc48ea0" released by "_delete_snapshot" :: held 2.501s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-56642f04-8e43-40f9-95e7-8d4ef2efd061" released by "delete_snapshot" :: held 2.544s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:36 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Created reservations ['20670b98-ec12-4f52-abc6-fd1cdbd126d2', '09a4bdaa-bbaa-435e-8468-52eeac5bf93d', '4e19e24a-4d6d-40d7-ba4d-c9f07cbcb4bc', '9c21852f-5242-4191-adca-0910ba787900'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Delete snapshot completed successfully. Nov 03 20:25:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1dca4810-24c7-4aa6-87da-6fae1207ebd7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-a4ae9f42-bf54-40ea-b79c-37d87bc48ea0-delete_snapshot" released by "delete_snapshot" :: held 2.910s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Flow 'volume_create_manager' (adabf502-2229-42b2-a1ce-9ae62204029a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7440ec-35e0-4c22-a72d-707d22f29b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7440ec-35e0-4c22-a72d-707d22f29b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-247120649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd9db67-1bed-478c-8934-f58ccfd5c190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de886c54370a44798ccba24aa6a7816c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:38Z,use_quota=True,user_id='ab05589aa3ea43dca0f7744a111ac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d356332e-571e-46c7-bf2b-f217e0e861fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d356332e-571e-46c7-bf2b-f217e0e861fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb99089-e355-43f3-b27d-a795e5a8349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb99089-e355-43f3-b27d-a795e5a8349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd9db67-1bed-478c-8934-f58ccfd5c190', 'volume_name': 'volume-8bd9db67-1bed-478c-8934-f58ccfd5c190', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2348f5b-4ce5-46c3-a92a-2836f2df14d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2348f5b-4ce5-46c3-a92a-2836f2df14d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec1e118-a072-4aa4-b7fb-bf144b1f9f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:38 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Volume 8bd9db67-1bed-478c-8934-f58ccfd5c190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd9db67-1bed-478c-8934-f58ccfd5c190', 'volume_size': 1} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-247120649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd9db67-1bed-478c-8934-f58ccfd5c190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de886c54370a44798ccba24aa6a7816c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:38Z,use_quota=True,user_id='ab05589aa3ea43dca0f7744a111ac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Creating volume 8bd9db67-1bed-478c-8934-f58ccfd5c190 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:38 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:25:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:38 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 1073741824 Nov 03 20:25:38 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:39 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 1073741824" returned: 0 in 0.665s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:39 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 Nov 03 20:25:39 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:39 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190" returned: 0 in 0.426s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec1e118-a072-4aa4-b7fb-bf144b1f9f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd9db67-1bed-478c-8934-f58ccfd5c190', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cc8a1b-b0da-4118-9e86-bf17fdd85cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:39 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Volume volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 (8bd9db67-1bed-478c-8934-f58ccfd5c190): created successfully Nov 03 20:25:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cc8a1b-b0da-4118-9e86-bf17fdd85cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Flow 'volume_create_manager' (adabf502-2229-42b2-a1ce-9ae62204029a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-53e947e1-32bd-4215-8a77-318d7fb490ab tempest-VolumesSnapshotTestJSON-1960482620 None] Created volume successfully. Nov 03 20:25:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-9c63e45a-c8dd-44d7-aa85-2ea3ec6be306 req-74e6ea55-57fa-4210-8e4c-f5a767dedce3 tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-9c63e45a-c8dd-44d7-aa85-2ea3ec6be306 req-74e6ea55-57fa-4210-8e4c-f5a767dedce3 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-9c63e45a-c8dd-44d7-aa85-2ea3ec6be306 req-74e6ea55-57fa-4210-8e4c-f5a767dedce3 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-9c63e45a-c8dd-44d7-aa85-2ea3ec6be306 req-74e6ea55-57fa-4210-8e4c-f5a767dedce3 tempest-ServerActionsTestOtherA-501095522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-93f302d9-cbee-454f-81ee-93682e0c0295', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '471acccf-2027-463d-9aef-ea6d90e14785', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:25:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-9c63e45a-c8dd-44d7-aa85-2ea3ec6be306 req-74e6ea55-57fa-4210-8e4c-f5a767dedce3 tempest-ServerActionsTestOtherA-501095522 None] attachment_update completed successfully. Nov 03 20:25:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] Creating offline snapshot f350505e-f546-4dff-b551-6ab34d426ceb of volume 8bd9db67-1bed-478c-8934-f58ccfd5c190 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:25:41 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e83dcd-ebda-4ef0-b82a-2474207d96c6]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:41 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 Nov 03 20:25:41 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:41 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190" returned: 0 in 0.628s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:41 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb 1G Nov 03 20:25:41 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:42 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb 1G" returned: 0 in 0.510s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:42 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb Nov 03 20:25:42 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:42 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb" returned: 0 in 0.422s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:42 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb is being set with open permissions: ugo+rw Nov 03 20:25:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:42 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb Nov 03 20:25:42 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:43 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb" returned: 0 in 0.580s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:43 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.info Nov 03 20:25:43 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:43 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.info" returned: 0 in 0.588s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:43 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.info is being set with open permissions: ugo+rw Nov 03 20:25:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:43 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.info Nov 03 20:25:43 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:44 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.info" returned: 0 in 0.609s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.502s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-14f14b84-c55a-427e-ba8d-ee32b6238a94 tempest-VolumesSnapshotTestJSON-1960482620 None] Create snapshot completed successfully Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Flow 'volume_create_manager' (70a0f528-7513-4fd6-a72b-91de736e5eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b441ec-048d-478e-a229-9a7e9847bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b441ec-048d-478e-a229-9a7e9847bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1804446380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8966293f-d19b-4b5e-b86b-21a8fd105a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de886c54370a44798ccba24aa6a7816c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f350505e-f546-4dff-b551-6ab34d426ceb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:46Z,use_quota=True,user_id='ab05589aa3ea43dca0f7744a111ac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34cef26-78c7-4841-9204-7a714bb89f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34cef26-78c7-4841-9204-7a714bb89f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870b0bfa-df3a-4d19-9e0e-abe2de73cd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870b0bfa-df3a-4d19-9e0e-abe2de73cd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8966293f-d19b-4b5e-b86b-21a8fd105a6d', 'volume_name': 'volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d', 'volume_size': 2, 'snapshot_id': 'f350505e-f546-4dff-b551-6ab34d426ceb'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad1073a-0ec2-45d5-a185-cc7cc8756d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad1073a-0ec2-45d5-a185-cc7cc8756d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c55402-3acb-4ea7-839d-085044767c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:46 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Volume 8966293f-d19b-4b5e-b86b-21a8fd105a6d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d', 'volume_size': 2, 'snapshot_id': 'f350505e-f546-4dff-b551-6ab34d426ceb'} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-f350505e-f546-4dff-b551-6ab34d426ceb-8966293f-d19b-4b5e-b86b-21a8fd105a6d" by "_create_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-f350505e-f546-4dff-b551-6ab34d426ceb-8966293f-d19b-4b5e-b86b-21a8fd105a6d" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Creating volume 8966293f-d19b-4b5e-b86b-21a8fd105a6d from snapshot f350505e-f546-4dff-b551-6ab34d426ceb {{(pid=87342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-8966293f-d19b-4b5e-b86b-21a8fd105a6d" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-8966293f-d19b-4b5e-b86b-21a8fd105a6d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] snapshot: f350505e-f546-4dff-b551-6ab34d426ceb, volume: 8966293f-d19b-4b5e-b86b-21a8fd105a6d, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9f421d-117a-4b7f-906d-9e4b9c777ea2]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Flow 'volume_create_manager' (c8eeac8e-a722-4057-ad66-59db58bd7825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed2f17-ab97-447c-974a-509e1f16e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed2f17-ab97-447c-974a-509e1f16e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1224649684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224cd17e-101b-4b3a-8a72-b8f9748e8d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01388278e9ab440caa17e8f166a9db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:46Z,use_quota=True,user_id='6361068f8538424e98d8c3a91b353130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:46 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb Nov 03 20:25:46 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af42b8b-1d25-4154-98b6-02a593ffa9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af42b8b-1d25-4154-98b6-02a593ffa9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c576334-6fec-4602-a2c0-2103e92154e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c576334-6fec-4602-a2c0-2103e92154e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224cd17e-101b-4b3a-8a72-b8f9748e8d4f', 'volume_name': 'volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bd7c7b-6ce1-4b39-ac9e-44eedc065dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bd7c7b-6ce1-4b39-ac9e-44eedc065dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bcfabb-4893-4e25-ac83-5949941bb63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:46 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Volume 224cd17e-101b-4b3a-8a72-b8f9748e8d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f', 'volume_size': 1} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:46 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb" returned: 0 in 0.506s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bd9db67-1bed-478c-8934-f58ccfd5c190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e907f4cf-ec7e-42af-a6c3-4d3865dd67d1]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:47 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 Nov 03 20:25:47 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:47 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190" returned: 0 in 0.462s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:25:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:25:47 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:25:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:47 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d Nov 03 20:25:47 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:56 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=43,cinder:SELECT=65,cinder:INSERT=19,cinder:DELETE=2 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:25:56 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=58,cinder:INSERT=23,cinder:UPDATE=39,cinder:DELETE=7 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:25:58 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d" returned: 0 in 11.134s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:58 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190, size 1024.00 MB, duration 11.14 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:25:58 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Converted 1024.00 MB image at 91.95 MB/s Nov 03 20:25:58 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d is being set with open permissions: ugo+rw Nov 03 20:25:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:58 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d Nov 03 20:25:58 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:59 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d" returned: 0 in 0.438s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-8966293f-d19b-4b5e-b86b-21a8fd105a6d" released by "_copy_volume_from_snapshot" :: held 12.677s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-f350505e-f546-4dff-b551-6ab34d426ceb-8966293f-d19b-4b5e-b86b-21a8fd105a6d" released by "_create_volume_from_snapshot" :: held 12.779s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.809s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.408s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1224649684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224cd17e-101b-4b3a-8a72-b8f9748e8d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01388278e9ab440caa17e8f166a9db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:46Z,use_quota=True,user_id='6361068f8538424e98d8c3a91b353130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Creating volume 224cd17e-101b-4b3a-8a72-b8f9748e8d4f {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:59 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:59 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f 1073741824 Nov 03 20:25:59 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c55402-3acb-4ea7-839d-085044767c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d', 'volume_size': 2, 'snapshot_id': 'f350505e-f546-4dff-b551-6ab34d426ceb'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415c28ea-a284-43c0-ba6c-d5ad3ab59d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:59 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Volume volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d (8966293f-d19b-4b5e-b86b-21a8fd105a6d): created successfully Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415c28ea-a284-43c0-ba6c-d5ad3ab59d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Flow 'volume_create_manager' (70a0f528-7513-4fd6-a72b-91de736e5eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:59 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-fc2efda3-31ca-4c0c-9c06-e4a7bca21f36 tempest-VolumesSnapshotTestJSON-1960482620 None] Created volume successfully. Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fd1d9270-54d3-495f-b847-25bc415e2736 req-8e2116d7-d9f4-405d-a953-bacaa80e4d26 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:59 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f 1073741824" returned: 0 in 0.655s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:59 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f Nov 03 20:25:59 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-8966293f-d19b-4b5e-b86b-21a8fd105a6d-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-8966293f-d19b-4b5e-b86b-21a8fd105a6d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-8966293f-d19b-4b5e-b86b-21a8fd105a6d" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-8966293f-d19b-4b5e-b86b-21a8fd105a6d" acquired by "delete_volume" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d292a7d-84c7-4957-b765-0292799c0c3d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:00 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f" returned: 0 in 0.528s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fd1d9270-54d3-495f-b847-25bc415e2736 req-8e2116d7-d9f4-405d-a953-bacaa80e4d26 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.641s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fd1d9270-54d3-495f-b847-25bc415e2736 req-8e2116d7-d9f4-405d-a953-bacaa80e4d26 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bcfabb-4893-4e25-ac83-5949941bb63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3441a76d-5e09-4b57-b5ff-5a454712de7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:00 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Volume volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f (224cd17e-101b-4b3a-8a72-b8f9748e8d4f): created successfully Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3441a76d-5e09-4b57-b5ff-5a454712de7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:00 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d Nov 03 20:26:00 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Flow 'volume_create_manager' (c8eeac8e-a722-4057-ad66-59db58bd7825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fd1d9270-54d3-495f-b847-25bc415e2736 req-8e2116d7-d9f4-405d-a953-bacaa80e4d26 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0208107e-350f-42b2-a7ed-3c31e0c67e75', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:26:00 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-945dae3a-8bf6-4e3e-b47e-fde0969d6362 tempest-VolumesTransfersTest-1139927838 None] Created volume successfully. Nov 03 20:26:00 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-fd1d9270-54d3-495f-b847-25bc415e2736 req-8e2116d7-d9f4-405d-a953-bacaa80e4d26 tempest-TestServerVolumeAttachmentScenario-1159376168 None] attachment_update completed successfully. Nov 03 20:26:00 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d" returned: 0 in 0.575s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:00 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d Nov 03 20:26:00 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:01 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8966293f-d19b-4b5e-b86b-21a8fd105a6d" returned: 0 in 0.325s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-8966293f-d19b-4b5e-b86b-21a8fd105a6d" released by "delete_volume" :: held 0.993s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Created reservations ['e0a53b43-100b-41ec-9605-5fa1683c268b', '307822f3-a92d-4bbf-a5ca-4eb865911a6f', '10c39e58-69a7-4f45-bb6b-681d7b2d0218', 'bae066ff-e024-4996-9393-72d67d04801a'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:01 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:01 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:01 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.455s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:01 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Deleted volume successfully. Nov 03 20:26:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5456f372-141b-488f-bb55-d1aa4d6fcf2a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-8966293f-d19b-4b5e-b86b-21a8fd105a6d-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:02 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-69ae9df8-7e93-4594-8958-affc4ece1f5e tempest-VolumesTransfersTest-1211656632 None] Transfer volume completed successfully. Nov 03 20:26:03 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-fb6aa43b-e8b9-47ed-894c-23200ee5a6e1 req-f8b3e1e9-9241-421b-90ed-39f164f0c63c tempest-ServerActionsTestOtherA-501095522 None] Terminate volume connection completed successfully. Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fb6aa43b-e8b9-47ed-894c-23200ee5a6e1 req-f8b3e1e9-9241-421b-90ed-39f164f0c63c tempest-ServerActionsTestOtherA-501095522 None] Deleting attachment 471acccf-2027-463d-9aef-ea6d90e14785. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-f350505e-f546-4dff-b551-6ab34d426ceb-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-f350505e-f546-4dff-b551-6ab34d426ceb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-8bd9db67-1bed-478c-8934-f58ccfd5c190" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-8bd9db67-1bed-478c-8934-f58ccfd5c190" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-f350505e-f546-4dff-b551-6ab34d426ceb" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-f350505e-f546-4dff-b551-6ab34d426ceb" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Deleting offline snapshot f350505e-f546-4dff-b551-6ab34d426ceb of volume 8bd9db67-1bed-478c-8934-f58ccfd5c190 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] snapshot_file for this snap is: volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eeab45-254d-4550-bc85-70520939d4c3]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:03 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb Nov 03 20:26:03 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Acquiring lock "cinder-224cd17e-101b-4b3a-8a72-b8f9748e8d4f-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Lock "cinder-224cd17e-101b-4b3a-8a72-b8f9748e8d4f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Acquiring lock "cinder-quobyte-224cd17e-101b-4b3a-8a72-b8f9748e8d4f" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Lock "cinder-quobyte-224cd17e-101b-4b3a-8a72-b8f9748e8d4f" acquired by "delete_volume" :: waited 0.033s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb683dac-40ed-45ec-a721-0b59f8dc169c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:03 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f Nov 03 20:26:03 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:03 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb" returned: 0 in 0.534s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bd9db67-1bed-478c-8934-f58ccfd5c190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c8d781-4c41-4c76-bc01-ec66eb998223]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:04 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 Nov 03 20:26:04 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:04 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f" returned: 0 in 0.476s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:04 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f Nov 03 20:26:04 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:04 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-224cd17e-101b-4b3a-8a72-b8f9748e8d4f" returned: 0 in 0.454s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Lock "cinder-quobyte-224cd17e-101b-4b3a-8a72-b8f9748e8d4f" released by "delete_volume" :: held 0.999s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:04 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190" returned: 0 in 0.805s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:04 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb Nov 03 20:26:04 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Created reservations ['2ac129be-42df-4818-a90d-aaf43c1b2f62', 'e85e19b4-e362-42c5-9cac-f26aa04ce5b6', '1d786826-d13d-40bc-94c7-41c8e4fe2a34', 'f25caee9-8ad2-4e65-83a7-9b6ca33c7982'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:05 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:05 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fb6aa43b-e8b9-47ed-894c-23200ee5a6e1 req-ac307db3-80d6-4455-8b5d-230ec7c62257 tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fb6aa43b-e8b9-47ed-894c-23200ee5a6e1 req-ac307db3-80d6-4455-8b5d-230ec7c62257 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-fb6aa43b-e8b9-47ed-894c-23200ee5a6e1 req-ac307db3-80d6-4455-8b5d-230ec7c62257 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:05 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-fb6aa43b-e8b9-47ed-894c-23200ee5a6e1 req-ac307db3-80d6-4455-8b5d-230ec7c62257 tempest-ServerActionsTestOtherA-501095522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-93f302d9-cbee-454f-81ee-93682e0c0295', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3648e1cd-79a2-4b7b-9ba4-1432d27e570d', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb" returned: 0 in 0.471s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:05 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb Nov 03 20:26:05 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:05 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.363s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:05 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Deleted volume successfully. Nov 03 20:26:05 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-fb6aa43b-e8b9-47ed-894c-23200ee5a6e1 req-ac307db3-80d6-4455-8b5d-230ec7c62257 tempest-ServerActionsTestOtherA-501095522 None] attachment_update completed successfully. Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-41e81557-3e65-42b0-9544-ddf28c7c6a74 tempest-VolumesTransfersTest-167679262 None] Lock "cinder-224cd17e-101b-4b3a-8a72-b8f9748e8d4f-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:05 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190.f350505e-f546-4dff-b551-6ab34d426ceb" returned: 0 in 0.343s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-f350505e-f546-4dff-b551-6ab34d426ceb" released by "_delete_snapshot" :: held 2.300s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-8bd9db67-1bed-478c-8934-f58ccfd5c190" released by "delete_snapshot" :: held 2.348s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Created reservations ['6fa473d5-5c5f-40f9-91cc-8702c9d34292', 'b5dde9c3-f350-4719-bdd4-2bb8a4b2fbd4', '8345700f-9d63-41b1-88cc-53357ef3158a', '7fd956e7-b904-4256-87fd-56bb8ebedd81'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:05 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Delete snapshot completed successfully. Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f59e95a7-1e68-40b3-8234-75b8b5df05a4 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-f350505e-f546-4dff-b551-6ab34d426ceb-delete_snapshot" released by "delete_snapshot" :: held 2.518s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-d26ffc9d-b45e-4999-9478-d7e401e1776a req-9dd63a10-2799-4097-9a60-55f62ddb4bc2 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-d26ffc9d-b45e-4999-9478-d7e401e1776a req-9dd63a10-2799-4097-9a60-55f62ddb4bc2 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-d26ffc9d-b45e-4999-9478-d7e401e1776a req-9dd63a10-2799-4097-9a60-55f62ddb4bc2 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-d26ffc9d-b45e-4999-9478-d7e401e1776a req-9dd63a10-2799-4097-9a60-55f62ddb4bc2 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-599383d7-9c4d-4f34-9057-408924cbec03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f56c289a-7b63-48fe-a1d5-ace1d005b29e', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:26:06 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-d26ffc9d-b45e-4999-9478-d7e401e1776a req-9dd63a10-2799-4097-9a60-55f62ddb4bc2 tempest-TestServerVolumeAttachmentScenario-1159376168 None] attachment_update completed successfully. Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Flow 'volume_create_manager' (6ee07c44-ccb0-4a28-b6fc-e94a760b8e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3cc8e9-6c1f-4ad2-91a5-21c402dcd17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-8bd9db67-1bed-478c-8934-f58ccfd5c190-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3cc8e9-6c1f-4ad2-91a5-21c402dcd17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1115927868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d14776-477a-4ac9-9532-c51c77d03b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01388278e9ab440caa17e8f166a9db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:07Z,use_quota=True,user_id='6361068f8538424e98d8c3a91b353130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46496671-5106-42ec-a7eb-c0c827cf7911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46496671-5106-42ec-a7eb-c0c827cf7911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51db2a78-8594-450c-a10f-e87914b8a38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51db2a78-8594-450c-a10f-e87914b8a38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d14776-477a-4ac9-9532-c51c77d03b91', 'volume_name': 'volume-b7d14776-477a-4ac9-9532-c51c77d03b91', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99bce227-a7fa-410b-9630-d2cba8c52608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99bce227-a7fa-410b-9630-d2cba8c52608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c405815-d1af-4e68-9eb9-6336d8834e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:07 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Volume b7d14776-477a-4ac9-9532-c51c77d03b91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d14776-477a-4ac9-9532-c51c77d03b91', 'volume_size': 1} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1115927868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d14776-477a-4ac9-9532-c51c77d03b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01388278e9ab440caa17e8f166a9db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:07Z,use_quota=True,user_id='6361068f8538424e98d8c3a91b353130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Creating volume b7d14776-477a-4ac9-9532-c51c77d03b91 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:07 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-8bd9db67-1bed-478c-8934-f58ccfd5c190-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:07 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91 1073741824 Nov 03 20:26:07 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-8bd9db67-1bed-478c-8934-f58ccfd5c190" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-8bd9db67-1bed-478c-8934-f58ccfd5c190" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8951b5cf-476a-4e38-b970-4b4710422d99]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:07 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 Nov 03 20:26:07 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:07 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91 1073741824" returned: 0 in 0.564s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:07 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190" returned: 0 in 0.450s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:07 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190 Nov 03 20:26:07 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:07 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91 Nov 03 20:26:07 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:08 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8bd9db67-1bed-478c-8934-f58ccfd5c190" returned: 0 in 0.519s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-8bd9db67-1bed-478c-8934-f58ccfd5c190" released by "delete_volume" :: held 1.043s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:08 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91" returned: 0 in 0.483s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c405815-d1af-4e68-9eb9-6336d8834e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d14776-477a-4ac9-9532-c51c77d03b91', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c43a32-cd05-47b9-ae13-0180bf665e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:08 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Volume volume-b7d14776-477a-4ac9-9532-c51c77d03b91 (b7d14776-477a-4ac9-9532-c51c77d03b91): created successfully Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c43a32-cd05-47b9-ae13-0180bf665e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Flow 'volume_create_manager' (6ee07c44-ccb0-4a28-b6fc-e94a760b8e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Created reservations ['591040bf-96fc-4ca7-823c-fb2d942309c1', '7e8c7337-ef37-4297-a2d7-86babd9db5f1', '62d16ac8-416c-40d9-8e94-fec81f49129c', '11b80706-37d4-48ea-8b4b-e13bb8dd7c4e'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:08 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7c7d881d-38f2-45c6-a8cf-74ccaaafcd52 tempest-VolumesTransfersTest-1139927838 None] Created volume successfully. Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:08 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:08 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:08 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.278s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:08 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Deleted volume successfully. Nov 03 20:26:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-97cdf12b-e8a9-4ad4-8845-dee9651cbeb7 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-8bd9db67-1bed-478c-8934-f58ccfd5c190-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:09 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-6aecd957-b38a-475f-a83f-629e752af059 req-2a5f1b4f-885d-4d72-a291-a69282f3beb2 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Terminate volume connection completed successfully. Nov 03 20:26:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-6aecd957-b38a-475f-a83f-629e752af059 req-2a5f1b4f-885d-4d72-a291-a69282f3beb2 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Deleting attachment f56c289a-7b63-48fe-a1d5-ace1d005b29e. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:26:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Acquiring lock "cinder-b7d14776-477a-4ac9-9532-c51c77d03b91-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Lock "cinder-b7d14776-477a-4ac9-9532-c51c77d03b91-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Acquiring lock "cinder-quobyte-b7d14776-477a-4ac9-9532-c51c77d03b91" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Lock "cinder-quobyte-b7d14776-477a-4ac9-9532-c51c77d03b91" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:09 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68cdf56-a0ec-43d0-b067-15897e2646b8]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:10 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91 Nov 03 20:26:10 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:10 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91" returned: 0 in 0.601s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:10 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91 Nov 03 20:26:10 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Flow 'volume_create_manager' (82618945-2eab-4e9e-aa34-33f0dafa2661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f879c374-090c-48cc-a4a0-c6fa75e3ac91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f879c374-090c-48cc-a4a0-c6fa75e3ac91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1711381637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2709d2-5331-4781-87ad-230fc12d39ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de886c54370a44798ccba24aa6a7816c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:11Z,use_quota=True,user_id='ab05589aa3ea43dca0f7744a111ac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca27a57-ed98-4337-bd7d-4a932ef2751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca27a57-ed98-4337-bd7d-4a932ef2751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680ae9f7-31d7-4231-9214-a292ce693421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680ae9f7-31d7-4231-9214-a292ce693421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2709d2-5331-4781-87ad-230fc12d39ab', 'volume_name': 'volume-9d2709d2-5331-4781-87ad-230fc12d39ab', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6763ad2a-2944-42f8-b92f-32e78777421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6763ad2a-2944-42f8-b92f-32e78777421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3316c79b-2cba-4707-8d59-b08cc577b26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:10 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Volume 9d2709d2-5331-4781-87ad-230fc12d39ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2709d2-5331-4781-87ad-230fc12d39ab', 'volume_size': 1} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1711381637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2709d2-5331-4781-87ad-230fc12d39ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de886c54370a44798ccba24aa6a7816c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:11Z,use_quota=True,user_id='ab05589aa3ea43dca0f7744a111ac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Creating volume 9d2709d2-5331-4781-87ad-230fc12d39ab {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:10 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:26:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:11 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab 1073741824 Nov 03 20:26:11 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:11 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7d14776-477a-4ac9-9532-c51c77d03b91" returned: 0 in 0.684s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Lock "cinder-quobyte-b7d14776-477a-4ac9-9532-c51c77d03b91" released by "delete_volume" :: held 1.378s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Created reservations ['72e57995-fd58-4cf3-ae1d-7b66d1b1c508', 'd7837a14-6ae2-461e-9101-87420e625ce9', '8024499f-0e9c-4722-957d-4d4a5ba90ca8', 'ac4da974-2016-4f52-bb25-e1948257a6c1'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:11 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-96a4d6fe-3312-4400-84a5-9a1140575608 req-0be59ef1-0a2a-4c26-b27a-3df7910b035d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Terminate volume connection completed successfully. Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-96a4d6fe-3312-4400-84a5-9a1140575608 req-0be59ef1-0a2a-4c26-b27a-3df7910b035d tempest-TestServerVolumeAttachmentScenario-1159376168 None] Deleting attachment 0208107e-350f-42b2-a7ed-3c31e0c67e75. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:11 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:11 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:11 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.519s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:11 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:12 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Deleted volume successfully. Nov 03 20:26:12 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-93a75da5-173b-4834-b89a-bcb07a7f72e0 tempest-VolumesTransfersTest-167679262 None] Lock "cinder-b7d14776-477a-4ac9-9532-c51c77d03b91-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:12 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab 1073741824" returned: 0 in 1.115s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:12 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab Nov 03 20:26:12 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:12 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab" returned: 0 in 0.589s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3316c79b-2cba-4707-8d59-b08cc577b26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2709d2-5331-4781-87ad-230fc12d39ab', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d063ec74-d355-48d6-8616-f0ff38c07a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:12 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Volume volume-9d2709d2-5331-4781-87ad-230fc12d39ab (9d2709d2-5331-4781-87ad-230fc12d39ab): created successfully Nov 03 20:26:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d063ec74-d355-48d6-8616-f0ff38c07a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Flow 'volume_create_manager' (82618945-2eab-4e9e-aa34-33f0dafa2661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:12 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-6212627e-839e-4198-bcd3-7183ba8bda2c tempest-VolumesSnapshotTestJSON-1960482620 None] Created volume successfully. Nov 03 20:26:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] Creating offline snapshot c704484d-1956-4fa2-a324-3ba266121ad8 of volume 9d2709d2-5331-4781-87ad-230fc12d39ab {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:26:14 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f895180e-73cb-40bb-abb9-7ceab7d511d3]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:14 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab Nov 03 20:26:14 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:15 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab" returned: 0 in 0.713s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:15 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 1G Nov 03 20:26:15 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:15 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 1G" returned: 0 in 0.648s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2709d2-5331-4781-87ad-230fc12d39ab -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:15 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2709d2-5331-4781-87ad-230fc12d39ab -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 Nov 03 20:26:15 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:16 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2709d2-5331-4781-87ad-230fc12d39ab -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8" returned: 0 in 0.503s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:16 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 is being set with open permissions: ugo+rw Nov 03 20:26:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:16 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 Nov 03 20:26:16 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:16 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8" returned: 0 in 0.287s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:16 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.info Nov 03 20:26:16 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:16 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.info" returned: 0 in 0.341s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:16 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.info is being set with open permissions: ugo+rw Nov 03 20:26:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:16 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.info Nov 03 20:26:16 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:17 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.info" returned: 0 in 0.336s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.997s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-80cf1bdd-0cef-40b4-8418-bfe843c05476 tempest-VolumesSnapshotTestJSON-1960482620 None] Create snapshot completed successfully Nov 03 20:26:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "cinder-599383d7-9c4d-4f34-9057-408924cbec03-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "cinder-599383d7-9c4d-4f34-9057-408924cbec03-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "cinder-quobyte-599383d7-9c4d-4f34-9057-408924cbec03" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "cinder-quobyte-599383d7-9c4d-4f34-9057-408924cbec03" acquired by "delete_volume" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:17 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb73f26-d9c3-4ce2-815f-7710cc13b43e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:18 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03 Nov 03 20:26:18 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:18 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03" returned: 0 in 0.535s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:18 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03 Nov 03 20:26:18 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Flow 'volume_create_manager' (ce08f3b6-1b5a-4ee1-be77-5f9817a76f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab97599-c51b-459e-9c8c-634441560bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab97599-c51b-459e-9c8c-634441560bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2056291190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce77a83a-2d73-4fa0-9817-f78a964f3c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de886c54370a44798ccba24aa6a7816c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c704484d-1956-4fa2-a324-3ba266121ad8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:18Z,use_quota=True,user_id='ab05589aa3ea43dca0f7744a111ac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5456e35-b1bd-429d-9ea7-60dfcf2e1f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5456e35-b1bd-429d-9ea7-60dfcf2e1f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba78e281-a60e-487b-a808-0f7e96ee852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba78e281-a60e-487b-a808-0f7e96ee852d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ce77a83a-2d73-4fa0-9817-f78a964f3c4f', 'volume_name': 'volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f', 'volume_size': 1, 'snapshot_id': 'c704484d-1956-4fa2-a324-3ba266121ad8'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f02d8ae-cfad-4326-9f6d-ced7527bd5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f02d8ae-cfad-4326-9f6d-ced7527bd5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574fccc2-572d-45c9-86ba-089bfa7d2a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:18 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Volume ce77a83a-2d73-4fa0-9817-f78a964f3c4f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f', 'volume_size': 1, 'snapshot_id': 'c704484d-1956-4fa2-a324-3ba266121ad8'} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-c704484d-1956-4fa2-a324-3ba266121ad8-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" by "_create_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-c704484d-1956-4fa2-a324-3ba266121ad8-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Creating volume ce77a83a-2d73-4fa0-9817-f78a964f3c4f from snapshot c704484d-1956-4fa2-a324-3ba266121ad8 {{(pid=87342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] snapshot: c704484d-1956-4fa2-a324-3ba266121ad8, volume: ce77a83a-2d73-4fa0-9817-f78a964f3c4f, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:18 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-599383d7-9c4d-4f34-9057-408924cbec03" returned: 0 in 0.312s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[164754f1-833f-47c1-82dd-cf02f4e7df57]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "cinder-quobyte-599383d7-9c4d-4f34-9057-408924cbec03" released by "delete_volume" :: held 0.913s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Created reservations ['f0b9ebe7-96a3-4017-a850-2045277f93b4', '51a9eae5-ab0b-40a3-a6e0-90decf64cea7', '1c5e6a34-5a75-4e32-9041-8e884a5e42b4', '43c5dbe0-633d-40e4-98f8-ea1dd823bf61'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:18 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 Nov 03 20:26:18 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:18 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:18 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "cinder-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "cinder-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "cinder-quobyte-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "cinder-quobyte-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6" acquired by "delete_volume" :: waited 0.076s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e69b609-2ad8-41a0-8e38-b3c34636bcc3]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:19 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8" returned: 0 in 0.675s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d2709d2-5331-4781-87ad-230fc12d39ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:19 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.512s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:19 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Deleted volume successfully. Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[51028e2d-6c42-4ace-bbd3-f2754acebd70]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e546d1fb-5407-4193-a814-e4289aa3ff30 tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "cinder-599383d7-9c4d-4f34-9057-408924cbec03-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:19 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6 Nov 03 20:26:19 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:19 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab Nov 03 20:26:19 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:19 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6" returned: 0 in 0.597s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:19 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6 Nov 03 20:26:19 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:19 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab" returned: 0 in 0.519s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:26:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:20 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f Nov 03 20:26:20 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:20 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6" returned: 0 in 0.284s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "cinder-quobyte-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6" released by "delete_volume" :: held 0.949s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Created reservations ['08dbdad7-801b-443c-8f27-2e2ecccc0faf', '7de0deeb-e83d-4fa4-bc82-109c61d2cb08', '8e0ab85e-0d99-44a4-b415-9a5262171395', 'd1bbed6d-80e8-4b5d-947c-f5cee1ac9c8f'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:20 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:20 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:20 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.422s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:20 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Deleted volume successfully. Nov 03 20:26:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f314c567-07b6-4fac-aa6e-11c8db4d6b2e tempest-TestServerVolumeAttachmentScenario-1159376168 None] Lock "cinder-c1397bf5-87fe-44aa-aebe-1c7d1f2ff8d6-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:26:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:23 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:23 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:23 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (115c02ca-66b5-48ac-8d6a-4d51b161ba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0362d45-6736-41fe-8059-5fb7b616c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0362d45-6736-41fe-8059-5fb7b616c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2114929245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d20c0a-5262-4b59-ab10-cf7b17ec9e79,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:24Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84762f3-1854-4ea4-b117-9a0b04d5f4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84762f3-1854-4ea4-b117-9a0b04d5f4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1333da68-4b50-4ab7-ac94-5c0876793796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1333da68-4b50-4ab7-ac94-5c0876793796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6d20c0a-5262-4b59-ab10-cf7b17ec9e79', 'volume_name': 'volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516defbc-24f9-4868-8fe1-3639714213c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516defbc-24f9-4868-8fe1-3639714213c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73539c6-554d-4da6-8c31-db48c032a6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:24 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Volume d6d20c0a-5262-4b59-ab10-cf7b17ec9e79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79', 'volume_size': 1} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:24 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.789s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:26:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:26:29 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" returned: 0 in 9.394s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab, size 1024.00 MB, duration 9.40 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:26:29 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Converted 1024.00 MB image at 108.99 MB/s Nov 03 20:26:29 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f is being set with open permissions: ugo+rw Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:29 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f Nov 03 20:26:29 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:29 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" returned: 0 in 0.257s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" released by "_copy_volume_from_snapshot" :: held 10.977s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-c704484d-1956-4fa2-a324-3ba266121ad8-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" released by "_create_volume_from_snapshot" :: held 11.057s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.081s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.514s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2114929245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d20c0a-5262-4b59-ab10-cf7b17ec9e79,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:24Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Creating volume d6d20c0a-5262-4b59-ab10-cf7b17ec9e79 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:29 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:29 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79 1073741824 Nov 03 20:26:29 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574fccc2-572d-45c9-86ba-089bfa7d2a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f', 'volume_size': 1, 'snapshot_id': 'c704484d-1956-4fa2-a324-3ba266121ad8'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf33a60-c5ac-412c-85d7-c670937f3f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:29 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Volume volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f (ce77a83a-2d73-4fa0-9817-f78a964f3c4f): created successfully Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf33a60-c5ac-412c-85d7-c670937f3f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Flow 'volume_create_manager' (ce08f3b6-1b5a-4ee1-be77-5f9817a76f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:29 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0cdbe59a-0ad8-4ea8-84a4-88e3d6e5bbf3 tempest-VolumesSnapshotTestJSON-1960482620 None] Created volume successfully. Nov 03 20:26:30 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79 1073741824" returned: 0 in 0.446s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:30 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79 Nov 03 20:26:30 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:30 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79" returned: 0 in 0.239s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73539c6-554d-4da6-8c31-db48c032a6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7743b314-09c8-4e8e-a470-71ec2a336261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:30 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Volume volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79 (d6d20c0a-5262-4b59-ab10-cf7b17ec9e79): created successfully Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7743b314-09c8-4e8e-a470-71ec2a336261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (115c02ca-66b5-48ac-8d6a-4d51b161ba52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:30 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0fc7eaa8-5f2f-4a2f-a96d-e725df53aeeb tempest-VolumesGetTest-720043163 None] Created volume successfully. Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-ce77a83a-2d73-4fa0-9817-f78a964f3c4f-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-ce77a83a-2d73-4fa0-9817-f78a964f3c4f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fb3c30-ad9e-4b66-8fca-9f54a5fd7670]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:31 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f Nov 03 20:26:31 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:31 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" returned: 0 in 0.372s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:31 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f Nov 03 20:26:31 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:31 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" returned: 0 in 0.288s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-ce77a83a-2d73-4fa0-9817-f78a964f3c4f" released by "delete_volume" :: held 0.714s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:31 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Created reservations ['acc3bb24-1f77-458f-a4c9-9c7745609028', 'a7eb16dc-296d-4dce-8504-599c1805d382', '9c678f05-540a-4da3-acb2-c6478893178f', '1b6b72f1-c59b-4c70-97ec-9d6cbfebea9f'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:31 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:31 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:32 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.270s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:32 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Deleted volume successfully. Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32af0779-6c19-4035-b77d-cef8a263d68a tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-ce77a83a-2d73-4fa0-9817-f78a964f3c4f-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-c704484d-1956-4fa2-a324-3ba266121ad8-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-c704484d-1956-4fa2-a324-3ba266121ad8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-9d2709d2-5331-4781-87ad-230fc12d39ab" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-9d2709d2-5331-4781-87ad-230fc12d39ab" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-c704484d-1956-4fa2-a324-3ba266121ad8" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-c704484d-1956-4fa2-a324-3ba266121ad8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Deleting offline snapshot c704484d-1956-4fa2-a324-3ba266121ad8 of volume 9d2709d2-5331-4781-87ad-230fc12d39ab {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] snapshot_file for this snap is: volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[01db07b2-fa22-4ecf-8951-c97992cd04d4]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:32 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 Nov 03 20:26:32 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (25675fd2-5a90-4753-9a4a-ffe0237b710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb1323c-e0c8-4f6c-ad10-c89dcb67ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb1323c-e0c8-4f6c-ad10-c89dcb67ce09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1133665474',display_name='tempest-VolumesGetTest-Volume-1488690892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751997d4-20df-4b64-8269-d5c60c7a10c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:32Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9414d7-21b6-46d5-b08f-42d6dde91ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9414d7-21b6-46d5-b08f-42d6dde91ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b41c530-4e39-4dce-a6c6-080a552dc93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b41c530-4e39-4dce-a6c6-080a552dc93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '751997d4-20df-4b64-8269-d5c60c7a10c4', 'volume_name': 'volume-751997d4-20df-4b64-8269-d5c60c7a10c4', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beaaef06-87c8-4406-8fe0-a22b76f40e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beaaef06-87c8-4406-8fe0-a22b76f40e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1933f1c8-1e10-43b2-9d26-7fc0d076d8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:32 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Volume 751997d4-20df-4b64-8269-d5c60c7a10c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-751997d4-20df-4b64-8269-d5c60c7a10c4', 'volume_size': 1} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1133665474',display_name='tempest-VolumesGetTest-Volume-1488690892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751997d4-20df-4b64-8269-d5c60c7a10c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:32Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Creating volume 751997d4-20df-4b64-8269-d5c60c7a10c4 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:32 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:32 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4 1073741824 Nov 03 20:26:32 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:32 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8" returned: 0 in 0.453s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d2709d2-5331-4781-87ad-230fc12d39ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1fc874-9310-463d-aa10-e4a0f7e14761]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:32 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab Nov 03 20:26:32 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:32 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4 1073741824" returned: 0 in 0.482s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:33 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4 Nov 03 20:26:33 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:33 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4" returned: 0 in 0.326s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:33 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab" returned: 0 in 0.610s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1933f1c8-1e10-43b2-9d26-7fc0d076d8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751997d4-20df-4b64-8269-d5c60c7a10c4', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afecbd9a-9b67-4fc4-bef9-3a3e4ef4cfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:33 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 Nov 03 20:26:33 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:33 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Volume volume-751997d4-20df-4b64-8269-d5c60c7a10c4 (751997d4-20df-4b64-8269-d5c60c7a10c4): created successfully Nov 03 20:26:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afecbd9a-9b67-4fc4-bef9-3a3e4ef4cfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (25675fd2-5a90-4753-9a4a-ffe0237b710e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:33 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c314a7be-d65c-4ecb-ac34-2fb143feccac tempest-VolumesGetTest-720043163 None] Created volume successfully. Nov 03 20:26:33 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8" returned: 0 in 0.507s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:33 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8 Nov 03 20:26:33 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:34 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab.c704484d-1956-4fa2-a324-3ba266121ad8" returned: 0 in 0.284s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-c704484d-1956-4fa2-a324-3ba266121ad8" released by "_delete_snapshot" :: held 1.984s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-9d2709d2-5331-4781-87ad-230fc12d39ab" released by "delete_snapshot" :: held 2.027s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:34 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Created reservations ['d5373ce7-798c-4cc4-86e6-c683db28bbdc', 'e2f1c35a-1d3a-4afb-be90-7f3af97348a0', 'fd2b0f06-2e1d-4d9d-beb9-9866233f4837', '816b9cb4-685e-404b-88c4-c711305059a1'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:34 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Delete snapshot completed successfully. Nov 03 20:26:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e4c2304-49a5-4645-a77f-2a610b4a832e tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-c704484d-1956-4fa2-a324-3ba266121ad8-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-751997d4-20df-4b64-8269-d5c60c7a10c4-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Lock "cinder-751997d4-20df-4b64-8269-d5c60c7a10c4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-quobyte-751997d4-20df-4b64-8269-d5c60c7a10c4" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-751997d4-20df-4b64-8269-d5c60c7a10c4" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:34 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fad7eca-11e1-439f-95c1-5054b07cb859]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:34 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4 Nov 03 20:26:34 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:35 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4" returned: 0 in 0.383s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:35 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4 Nov 03 20:26:35 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-9d2709d2-5331-4781-87ad-230fc12d39ab-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:35 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-751997d4-20df-4b64-8269-d5c60c7a10c4" returned: 0 in 0.315s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-751997d4-20df-4b64-8269-d5c60c7a10c4" released by "delete_volume" :: held 0.756s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-9d2709d2-5331-4781-87ad-230fc12d39ab-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-9d2709d2-5331-4781-87ad-230fc12d39ab" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-9d2709d2-5331-4781-87ad-230fc12d39ab" acquired by "delete_volume" :: waited 0.034s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f718dd0-cead-4eea-bbb0-96e7c079bd43]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Created reservations ['ea33d549-669c-4a30-aaed-23266c70a24b', '07162ba2-cade-4a80-9ba1-4044ecea1ed2', 'f1779d68-233c-4266-b510-cf76dd10a135', 'ea23b0fa-8dbb-41ac-a38a-7793bb895e37'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:35 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab Nov 03 20:26:35 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:35 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:35 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Lock "cinder-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:36 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.303s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:36 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Deleted volume successfully. Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-quobyte-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-70535d81-a071-42e9-abfa-2f2d51949371 tempest-VolumesGetTest-720043163 None] Lock "cinder-751997d4-20df-4b64-8269-d5c60c7a10c4-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b36144-a297-4f76-a1af-6f2c6eaf550b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:36 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab" returned: 0 in 0.593s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:36 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab Nov 03 20:26:36 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:36 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79 Nov 03 20:26:36 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:36 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9d2709d2-5331-4781-87ad-230fc12d39ab" returned: 0 in 0.303s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-9d2709d2-5331-4781-87ad-230fc12d39ab" released by "delete_volume" :: held 1.026s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:36 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79" returned: 0 in 0.446s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:36 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79 Nov 03 20:26:36 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Created reservations ['522a0972-0aba-4d84-a2aa-eca6f5611fdd', '9e1c9362-a2b0-4d6c-90eb-8c1f12d0dcd8', '52623322-140e-43c5-a8a3-a29e69af2347', '1ad0d227-d6f3-422d-a3ee-8fb6980cc555'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:36 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:36 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:37 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79" returned: 0 in 0.378s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79" released by "delete_volume" :: held 0.883s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Created reservations ['96fee524-5db4-41ed-bb10-4b0404b374dd', '2e4f6fd5-46c1-44de-b35d-214160fcdf32', '941af669-b13e-4647-a30b-bb96535081f0', 'd07ece6d-7543-494c-aed5-c77d94ed3b59'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:37 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.368s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Deleted volume successfully. Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fbae1bd-8ab3-4fed-be2d-f9dab1e8efca tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-9d2709d2-5331-4781-87ad-230fc12d39ab-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:37 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:37 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:37 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.476s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Deleted volume successfully. Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0323eaa9-f356-4940-88b6-2ebdf6192d80 tempest-VolumesGetTest-720043163 None] Lock "cinder-d6d20c0a-5262-4b59-ab10-cf7b17ec9e79-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-56642f04-8e43-40f9-95e7-8d4ef2efd061-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-56642f04-8e43-40f9-95e7-8d4ef2efd061-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "cinder-quobyte-56642f04-8e43-40f9-95e7-8d4ef2efd061" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-56642f04-8e43-40f9-95e7-8d4ef2efd061" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:38 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[500f1646-46b2-4d50-abee-bab3ffe9354c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:38 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 Nov 03 20:26:38 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:38 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061" returned: 0 in 0.626s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:38 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061 Nov 03 20:26:38 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:39 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-56642f04-8e43-40f9-95e7-8d4ef2efd061" returned: 0 in 0.386s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-quobyte-56642f04-8e43-40f9-95e7-8d4ef2efd061" released by "delete_volume" :: held 1.133s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (0842dbed-9062-4649-a61b-62ee054acad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04c8610-ee78-4eaf-9c2a-b7a241ffb7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04c8610-ee78-4eaf-9c2a-b7a241ffb7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-571382273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ca74da-b603-4def-9e46-0c0888b68624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:39Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fa800c-c28b-4984-9761-4e857b9a175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fa800c-c28b-4984-9761-4e857b9a175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf9ac88-0548-4abd-b98f-0b1fad7ef7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf9ac88-0548-4abd-b98f-0b1fad7ef7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ca74da-b603-4def-9e46-0c0888b68624', 'volume_name': 'volume-f7ca74da-b603-4def-9e46-0c0888b68624', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17eb1f1-9e00-4464-829d-7ec39633e92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17eb1f1-9e00-4464-829d-7ec39633e92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d7a6c0-7e91-4355-9cd4-8cbd96a97aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:39 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Volume f7ca74da-b603-4def-9e46-0c0888b68624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ca74da-b603-4def-9e46-0c0888b68624', 'volume_size': 1} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-571382273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ca74da-b603-4def-9e46-0c0888b68624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:39Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Creating volume f7ca74da-b603-4def-9e46-0c0888b68624 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:39 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:39 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 1073741824 Nov 03 20:26:39 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Created reservations ['40f45aa0-f598-4827-ab20-bd0dd8adabe8', '517d1341-c655-4b44-9d2f-99a7e3e043e9', 'fff4c3f7-bb43-4331-a132-199802bb3289', 'b73f4d63-3f6f-426a-bf20-30bd64f419e6'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:39 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:39 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-66343229-90e3-4374-9f42-8ac6c8668149 req-faca01fb-e8cc-42b7-b1c4-4d3e8ad185cd tempest-ServerActionsTestOtherA-501095522 None] Terminate volume connection completed successfully. Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-66343229-90e3-4374-9f42-8ac6c8668149 req-faca01fb-e8cc-42b7-b1c4-4d3e8ad185cd tempest-ServerActionsTestOtherA-501095522 None] Deleting attachment 3648e1cd-79a2-4b7b-9ba4-1432d27e570d. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Flow 'volume_create_manager' (4b6c435f-943b-4a7d-a822-730d86381164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a093a94d-fd16-43ab-841a-d95278cef389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a093a94d-fd16-43ab-841a-d95278cef389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16418a37-58fc-4580-9ad9-5deca437d8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b69b52331243a485d4ec40f688efea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:40Z,use_quota=True,user_id='99fd7996ef154131b1d7f7db5940ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bfe3ae-203f-42c3-9109-2699dacd4432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bfe3ae-203f-42c3-9109-2699dacd4432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822a2524-79fc-49f3-b894-969bcaea4856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822a2524-79fc-49f3-b894-969bcaea4856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16418a37-58fc-4580-9ad9-5deca437d8a9', 'volume_name': 'volume-16418a37-58fc-4580-9ad9-5deca437d8a9', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5ae5aa-818e-4e1f-a425-c683d0b8bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5ae5aa-818e-4e1f-a425-c683d0b8bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b2844e-dbe3-446e-9a19-22fd197b67de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:39 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Volume 16418a37-58fc-4580-9ad9-5deca437d8a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16418a37-58fc-4580-9ad9-5deca437d8a9', 'volume_size': 1} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:39 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.320s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Deleted volume successfully. Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "cinder-93f302d9-cbee-454f-81ee-93682e0c0295-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ad89237-d3cc-4943-9d30-b7a62105c036 tempest-VolumesSnapshotTestJSON-1960482620 None] Lock "cinder-56642f04-8e43-40f9-95e7-8d4ef2efd061-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Lock "cinder-93f302d9-cbee-454f-81ee-93682e0c0295-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "cinder-quobyte-93f302d9-cbee-454f-81ee-93682e0c0295" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Lock "cinder-quobyte-93f302d9-cbee-454f-81ee-93682e0c0295" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[22032bdc-7f3d-407d-992b-43ccae9b505b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:40 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 1073741824" returned: 0 in 0.791s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:40 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 Nov 03 20:26:40 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:40 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 Nov 03 20:26:40 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:40 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624" returned: 0 in 0.314s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16418a37-58fc-4580-9ad9-5deca437d8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b69b52331243a485d4ec40f688efea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:40Z,use_quota=True,user_id='99fd7996ef154131b1d7f7db5940ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Creating volume 16418a37-58fc-4580-9ad9-5deca437d8a9 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:40 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:40 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295" returned: 0 in 0.425s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:40 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9 1073741824 Nov 03 20:26:40 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d7a6c0-7e91-4355-9cd4-8cbd96a97aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ca74da-b603-4def-9e46-0c0888b68624', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:40 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295 Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0333bf-9063-494f-a5f0-41cc6293b78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:40 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:40 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Volume volume-f7ca74da-b603-4def-9e46-0c0888b68624 (f7ca74da-b603-4def-9e46-0c0888b68624): created successfully Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0333bf-9063-494f-a5f0-41cc6293b78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (0842dbed-9062-4649-a61b-62ee054acad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ec181015-d50c-4b77-94ab-742655c502bb tempest-VolumesGetTest-720043163 None] Created volume successfully. Nov 03 20:26:40 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93f302d9-cbee-454f-81ee-93682e0c0295" returned: 0 in 0.300s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Lock "cinder-quobyte-93f302d9-cbee-454f-81ee-93682e0c0295" released by "delete_volume" :: held 0.790s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.quota [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Created reservations ['f5062af8-fa33-488e-9af8-6288d4c6dfce', '206c8fa2-10c2-4432-bb8e-3144c4dedbaf', '14724210-29a8-4ab3-85a2-28118ee43a05', 'aa493f8b-0f4a-4619-b5b5-81eb86c3cb13'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:40 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:40 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:40 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9 1073741824" returned: 0 in 0.557s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:41 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9 Nov 03 20:26:41 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "cinder-e7d0ca99-dcf0-41a7-a935-f5814596e95a-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Lock "cinder-e7d0ca99-dcf0-41a7-a935-f5814596e95a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "cinder-quobyte-e7d0ca99-dcf0-41a7-a935-f5814596e95a" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Lock "cinder-quobyte-e7d0ca99-dcf0-41a7-a935-f5814596e95a" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[623b1a7b-8809-4154-a93a-bcaa18e5540e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:41 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a Nov 03 20:26:41 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:41 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.418s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.manager [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:41 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Deleted volume successfully. Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-66343229-90e3-4374-9f42-8ac6c8668149 req-1b5ef6a5-c6df-44f3-a785-2b3106c1550b tempest-ServerActionsTestOtherA-501095522 None] Lock "cinder-93f302d9-cbee-454f-81ee-93682e0c0295-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:41 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9" returned: 0 in 0.435s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b2844e-dbe3-446e-9a19-22fd197b67de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16418a37-58fc-4580-9ad9-5deca437d8a9', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d7d0b9-2c1d-4205-a5f6-b0f1a1280292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:41 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Volume volume-16418a37-58fc-4580-9ad9-5deca437d8a9 (16418a37-58fc-4580-9ad9-5deca437d8a9): created successfully Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d7d0b9-2c1d-4205-a5f6-b0f1a1280292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Flow 'volume_create_manager' (4b6c435f-943b-4a7d-a822-730d86381164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:41 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-58404b68-80de-4735-b698-229b2531ba38 tempest-CinderUnicodeTest-601075759 None] Created volume successfully. Nov 03 20:26:41 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a" returned: 0 in 0.573s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:41 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a Nov 03 20:26:41 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:41 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (dcc7af33-3eec-4fbd-bb61-1efec3bffd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f109e984-d9cc-4261-aef7-3290f93a76ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f109e984-d9cc-4261-aef7-3290f93a76ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1881545785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c2dffe-8d29-431a-b6d6-4f51764046d6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f7ca74da-b603-4def-9e46-0c0888b68624,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:42Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b126d70f-8fcc-4634-85f0-04589ebd2633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b126d70f-8fcc-4634-85f0-04589ebd2633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d42d5cc-20b6-41e6-bf11-25f0860cef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d42d5cc-20b6-41e6-bf11-25f0860cef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '66c2dffe-8d29-431a-b6d6-4f51764046d6', 'volume_name': 'volume-66c2dffe-8d29-431a-b6d6-4f51764046d6', 'volume_size': 1, 'source_volid': 'f7ca74da-b603-4def-9e46-0c0888b68624', 'source_volstatus': 'available'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78deb34a-eefa-4e40-ad58-a30c617de244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78deb34a-eefa-4e40-ad58-a30c617de244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:42 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76ea826-130e-40cc-b743-7d77601819dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:42 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Volume 66c2dffe-8d29-431a-b6d6-4f51764046d6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-66c2dffe-8d29-431a-b6d6-4f51764046d6', 'volume_size': 1, 'source_volid': 'f7ca74da-b603-4def-9e46-0c0888b68624', 'source_volstatus': 'available'} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e7d0ca99-dcf0-41a7-a935-f5814596e95a" returned: 0 in 0.361s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:42 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Cloning volume f7ca74da-b603-4def-9e46-0c0888b68624 to volume 66c2dffe-8d29-431a-b6d6-4f51764046d6 Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Lock "cinder-quobyte-e7d0ca99-dcf0-41a7-a935-f5814596e95a" released by "delete_volume" :: held 1.042s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Creating offline snapshot 8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 of volume f7ca74da-b603-4def-9e46-0c0888b68624 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ace0e7-13dd-49d0-834e-13efc559879d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Created reservations ['76ed2780-cd90-477f-9f53-3540356a7768', '9ce0b5f1-71f8-4e0e-b67e-0d95624141ba', 'd731d4fc-4f9d-44df-9814-afacd304fbb6', '579e1896-da0a-433a-b83a-6f2920a1916a'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:42 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 Nov 03 20:26:42 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:42 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:26:42 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Flow 'volume_create_manager' (c6849a0a-3e5e-4e0e-b73c-b25cab56706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73f72a4-b82a-4004-a5ed-786e79f51f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73f72a4-b82a-4004-a5ed-786e79f51f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-697691974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa04afdc-4781-4f94-881a-d8f75fe0523c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b69b52331243a485d4ec40f688efea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:42Z,use_quota=True,user_id='99fd7996ef154131b1d7f7db5940ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b843c067-34e4-4c23-9e62-c12d24f1921e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b843c067-34e4-4c23-9e62-c12d24f1921e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618798b9-7f5c-40d9-b54a-aaff33a41729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618798b9-7f5c-40d9-b54a-aaff33a41729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa04afdc-4781-4f94-881a-d8f75fe0523c', 'volume_name': 'volume-fa04afdc-4781-4f94-881a-d8f75fe0523c', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ced3f8-7c53-41b1-9b2c-24b9c0373f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ced3f8-7c53-41b1-9b2c-24b9c0373f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70959c83-271f-424e-96f7-b851ede49b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:42 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Volume fa04afdc-4781-4f94-881a-d8f75fe0523c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa04afdc-4781-4f94-881a-d8f75fe0523c', 'volume_size': 1} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:42 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.291s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Deleted volume successfully. Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3ebf2135-1e45-4bd3-b49d-71b48747e610 tempest-ServerActionsTestOtherA-501095522 None] Lock "cinder-e7d0ca99-dcf0-41a7-a935-f5814596e95a-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:42 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624" returned: 0 in 0.468s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:42 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 1G Nov 03 20:26:42 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:43 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 1G" returned: 0 in 0.407s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ca74da-b603-4def-9e46-0c0888b68624 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:43 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ca74da-b603-4def-9e46-0c0888b68624 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 Nov 03 20:26:43 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:43 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ca74da-b603-4def-9e46-0c0888b68624 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446" returned: 0 in 0.369s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:43 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 is being set with open permissions: ugo+rw Nov 03 20:26:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:43 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 Nov 03 20:26:43 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:43 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446" returned: 0 in 0.281s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:44 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.info Nov 03 20:26:44 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:44 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.info" returned: 0 in 0.374s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:44 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.info is being set with open permissions: ugo+rw Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:44 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.info Nov 03 20:26:44 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:44 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.info" returned: 0 in 0.353s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-quobyte-66c2dffe-8d29-431a-b6d6-4f51764046d6" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-66c2dffe-8d29-431a-b6d6-4f51764046d6" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] snapshot: 8febabe4-d5e0-4f8b-8c89-c7cdf7deb446, volume: 66c2dffe-8d29-431a-b6d6-4f51764046d6, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9e7bed-d836-4a73-98f4-6e20183c32ac]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:44 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 Nov 03 20:26:44 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:45 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446" returned: 0 in 0.387s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7ca74da-b603-4def-9e46-0c0888b68624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:45 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d241b1-b79c-4759-9733-5767a7a9b7ff]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:45 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 Nov 03 20:26:45 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:45 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624" returned: 0 in 0.522s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:26:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:26:45 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:26:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:45 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 Nov 03 20:26:45 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=114,cinder:UPDATE=147,cinder:INSERT=41,cinder:DELETE=12 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:26:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=139,cinder:UPDATE=150,cinder:INSERT=31,cinder:DELETE=11 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:26:53 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6" returned: 0 in 8.268s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:53 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624, size 1024.00 MB, duration 8.27 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:26:53 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Converted 1024.00 MB image at 123.84 MB/s Nov 03 20:26:53 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 is being set with open permissions: ugo+rw Nov 03 20:26:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:54 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 Nov 03 20:26:54 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:54 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6" returned: 0 in 0.252s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-66c2dffe-8d29-431a-b6d6-4f51764046d6" released by "_copy_volume_from_snapshot" :: held 9.522s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-quobyte-8febabe4-d5e0-4f8b-8c89-c7cdf7deb446" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-8febabe4-d5e0-4f8b-8c89-c7cdf7deb446" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Deleting offline snapshot 8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 of volume f7ca74da-b603-4def-9e46-0c0888b68624 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] snapshot_file for this snap is: volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[11682444-b56c-4f86-8f30-5de100f63be2]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:54 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 Nov 03 20:26:54 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:54 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446" returned: 0 in 0.489s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7ca74da-b603-4def-9e46-0c0888b68624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[befc6fdd-bbf7-41df-80dc-ee88e83a07f9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:54 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 Nov 03 20:26:54 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:55 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624" returned: 0 in 0.556s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:55 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 Nov 03 20:26:55 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:55 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446" returned: 0 in 0.460s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:55 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446 Nov 03 20:26:55 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:56 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624.8febabe4-d5e0-4f8b-8c89-c7cdf7deb446" returned: 0 in 0.320s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-8febabe4-d5e0-4f8b-8c89-c7cdf7deb446" released by "_delete_snapshot" :: held 1.955s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Flow 'volume_create_manager' (cd4e7266-6e6e-4fe0-882f-23fd7a1a870f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd54bf8-9e6c-43a1-8b73-1f3833b94195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd54bf8-9e6c-43a1-8b73-1f3833b94195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a511a3-64cc-4159-90a9-049f7c04d608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3200a233b02d4215b68dda75143b7f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:56Z,use_quota=True,user_id='778d705eaf5d4f57ab88b3fde15dc096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82ecb0f3-54fe-4616-a16b-84885b1a608b),volume_type_id=82ecb0f3-54fe-4616-a16b-84885b1a608b)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9d694d-65b2-4a80-9d07-6b5ff1f53e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9d694d-65b2-4a80-9d07-6b5ff1f53e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601c23c5-a5a9-4e2f-96a5-5a62256d5600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.image.glance [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Creating Keystone auth plugin from conf {{(pid=87342) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.135s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.659s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-697691974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa04afdc-4781-4f94-881a-d8f75fe0523c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b69b52331243a485d4ec40f688efea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:42Z,use_quota=True,user_id='99fd7996ef154131b1d7f7db5940ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Creating volume fa04afdc-4781-4f94-881a-d8f75fe0523c {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:56 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76ea826-130e-40cc-b743-7d77601819dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c2dffe-8d29-431a-b6d6-4f51764046d6', 'volume_size': 1, 'source_volid': 'f7ca74da-b603-4def-9e46-0c0888b68624', 'source_volstatus': 'available'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbac31b-69c4-46f7-8994-0e31c33e069b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:56 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c 1073741824 Nov 03 20:26:56 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:56 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Volume volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 (66c2dffe-8d29-431a-b6d6-4f51764046d6): created successfully Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbac31b-69c4-46f7-8994-0e31c33e069b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (dcc7af33-3eec-4fbd-bb61-1efec3bffd3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:56 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5e4a9e77-59ff-41f8-bdcf-714ac6fd7aa8 tempest-VolumesGetTest-720043163 None] Created volume successfully. Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601c23c5-a5a9-4e2f-96a5-5a62256d5600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a7a511a3-64cc-4159-90a9-049f7c04d608', 'volume_name': 'volume-a7a511a3-64cc-4159-90a9-049f7c04d608', 'volume_size': 1, 'image_id': '8d5e9d22-53f9-4650-9c19-050345b494a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d5e9d22-53f9-4650-9c19-050345b494a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78aa9c2828bf581135890994424b6fc8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3200a233b02d4215b68dda75143b7f73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da9bba193156731522c1d102565573d25c7d4f8ce0dda754ca07d3b09656149816be7e458e0ba1fb560bbd16a18729c66334ca3fbce4716a6a8a1549cae05b9f', 'id': '8d5e9d22-53f9-4650-9c19-050345b494a7', 'created_at': datetime.datetime(2026, 11, 3, 19, 26, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 26, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d5e9d22-53f9-4650-9c19-050345b494a7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64e2a00-f8fe-4278-9c18-66456a7005fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64e2a00-f8fe-4278-9c18-66456a7005fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b2c15a-a693-4419-b71c-32627ba1a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:56 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Volume a7a511a3-64cc-4159-90a9-049f7c04d608: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a7a511a3-64cc-4159-90a9-049f7c04d608', 'volume_size': 1, 'image_id': '8d5e9d22-53f9-4650-9c19-050345b494a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d5e9d22-53f9-4650-9c19-050345b494a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78aa9c2828bf581135890994424b6fc8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3200a233b02d4215b68dda75143b7f73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da9bba193156731522c1d102565573d25c7d4f8ce0dda754ca07d3b09656149816be7e458e0ba1fb560bbd16a18729c66334ca3fbce4716a6a8a1549cae05b9f', 'id': '8d5e9d22-53f9-4650-9c19-050345b494a7', 'created_at': datetime.datetime(2026, 11, 3, 19, 26, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 26, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d5e9d22-53f9-4650-9c19-050345b494a7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Trying to clone a7a511a3-64cc-4159-90a9-049f7c04d608 from image 8d5e9d22-53f9-4650-9c19-050345b494a7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d5e9d22-53f9-4650-9c19-050345b494a7', 'metadata': {}}]). {{(pid=87342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:26:56 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Image download 0.00 MB at 0.00 MB/s Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82e5660-b2db-4ac7-97e1-b79a85b72f1d]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:56 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c 1073741824" returned: 0 in 0.626s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:57 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD Nov 03 20:26:57 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:57 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c Nov 03 20:26:57 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:57 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:57 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c" returned: 0 in 0.288s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70959c83-271f-424e-96f7-b851ede49b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa04afdc-4781-4f94-881a-d8f75fe0523c', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87890e7-efc3-4340-bc1c-97ee592214fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:57 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Volume volume-fa04afdc-4781-4f94-881a-d8f75fe0523c (fa04afdc-4781-4f94-881a-d8f75fe0523c): created successfully Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87890e7-efc3-4340-bc1c-97ee592214fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Flow 'volume_create_manager' (c6849a0a-3e5e-4e0e-b73c-b25cab56706c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:57 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a5a23f35-3c89-4b23-9fcb-41065e6df492 tempest-CinderUnicodeTest-601075759 None] Created volume successfully. Nov 03 20:26:57 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD Nov 03 20:26:57 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:57 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD" returned: 1 in 0.441s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Temporary image 8d5e9d22-53f9-4650-9c19-050345b494a7 is fetched for user 778d705eaf5d4f57ab88b3fde15dc096. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca81090b-946d-42e6-bb9a-8398761f3c97]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:57 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD Nov 03 20:26:57 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (a8caf3c1-c31c-41a0-92c0-6945a7815615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:58 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a961468-4025-4de7-89df-9d45ffd03588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a961468-4025-4de7-89df-9d45ffd03588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-539602415',display_name='tempest-VolumesGetTest-Volume-1367175934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da441ccb-dbd0-446a-9a62-ec628b302462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:58Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987321f1-eb0b-4ff4-8ae8-42ea0cf92860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987321f1-eb0b-4ff4-8ae8-42ea0cf92860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a13ba88-dd94-40d9-bb05-64ebc5ab6576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a13ba88-dd94-40d9-bb05-64ebc5ab6576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da441ccb-dbd0-446a-9a62-ec628b302462', 'volume_name': 'volume-da441ccb-dbd0-446a-9a62-ec628b302462', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c159cfa-1b2d-4cf4-bbc6-2c7d5cfa20da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c159cfa-1b2d-4cf4-bbc6-2c7d5cfa20da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317f02b7-f091-40cd-8f12-458176708464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:58 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Volume da441ccb-dbd0-446a-9a62-ec628b302462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da441ccb-dbd0-446a-9a62-ec628b302462', 'volume_size': 1} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-539602415',display_name='tempest-VolumesGetTest-Volume-1367175934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da441ccb-dbd0-446a-9a62-ec628b302462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:58Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Creating volume da441ccb-dbd0-446a-9a62-ec628b302462 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:58 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:58 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462 1073741824 Nov 03 20:26:58 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:58 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD Nov 03 20:26:58 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:58 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD" returned: 1 in 0.384s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:58 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462 1073741824" returned: 0 in 0.500s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:58 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462 Nov 03 20:26:58 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:59 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462" returned: 0 in 0.270s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.793s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317f02b7-f091-40cd-8f12-458176708464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da441ccb-dbd0-446a-9a62-ec628b302462', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7618c7e-9e41-4ff0-a262-7bf61d3bb4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] Creating offline snapshot f665ebdc-b107-4e2e-a0a0-a173f646cd43 of volume fa04afdc-4781-4f94-881a-d8f75fe0523c {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:26:59 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Volume volume-da441ccb-dbd0-446a-9a62-ec628b302462 (da441ccb-dbd0-446a-9a62-ec628b302462): created successfully Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7618c7e-9e41-4ff0-a262-7bf61d3bb4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (a8caf3c1-c31c-41a0-92c0-6945a7815615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb648a26-ed23-4742-b290-658d3ef15baa]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:59 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5755b27f-7569-4bc1-8c3e-4622ce71c4d3 tempest-VolumesGetTest-720043163 None] Created volume successfully. Nov 03 20:26:59 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c Nov 03 20:26:59 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:59 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c" returned: 0 in 0.418s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:59 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 1G Nov 03 20:26:59 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:00 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 1G" returned: 0 in 0.489s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa04afdc-4781-4f94-881a-d8f75fe0523c -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:00 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa04afdc-4781-4f94-881a-d8f75fe0523c -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 Nov 03 20:27:00 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-da441ccb-dbd0-446a-9a62-ec628b302462-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Lock "cinder-da441ccb-dbd0-446a-9a62-ec628b302462-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-quobyte-da441ccb-dbd0-446a-9a62-ec628b302462" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-da441ccb-dbd0-446a-9a62-ec628b302462" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a469932-b90d-4ae4-af6c-c4ddd347377f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:00 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa04afdc-4781-4f94-881a-d8f75fe0523c -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43" returned: 0 in 0.373s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:00 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 is being set with open permissions: ugo+rw Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:00 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 Nov 03 20:27:00 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:00 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462 Nov 03 20:27:00 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:00 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43" returned: 0 in 0.256s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:00 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.info Nov 03 20:27:00 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:00 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462" returned: 0 in 0.408s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:00 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462 Nov 03 20:27:00 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:01 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.info" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:01 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.info is being set with open permissions: ugo+rw Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:01 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.info Nov 03 20:27:01 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:01 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-da441ccb-dbd0-446a-9a62-ec628b302462" returned: 0 in 0.268s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-da441ccb-dbd0-446a-9a62-ec628b302462" released by "delete_volume" :: held 0.740s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Created reservations ['c5e8302a-700b-4eb3-8860-2b7b1389e6c0', 'eca9037d-a7cb-4476-a97b-5877783181b0', 'd98140e4-f6b6-48c8-868c-274079fb7d60', 'fa8ad511-1f4d-4f76-a547-4137daa4802c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:01 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:01 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:01 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.info" returned: 0 in 0.273s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.752s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a511a3-64cc-4159-90a9-049f7c04d608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3200a233b02d4215b68dda75143b7f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:56Z,use_quota=True,user_id='778d705eaf5d4f57ab88b3fde15dc096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82ecb0f3-54fe-4616-a16b-84885b1a608b),volume_type_id=82ecb0f3-54fe-4616-a16b-84885b1a608b)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Creating volume a7a511a3-64cc-4159-90a9-049f7c04d608 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:01 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:01 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 1073741824 Nov 03 20:27:01 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-075c34c6-9def-407e-b845-c96874ffa04b tempest-CinderUnicodeTest-601075759 None] Create snapshot completed successfully Nov 03 20:27:01 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-66c2dffe-8d29-431a-b6d6-4f51764046d6-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:01 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.316s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Lock "cinder-66c2dffe-8d29-431a-b6d6-4f51764046d6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:01 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Deleted volume successfully. Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8d17d2a8-0ea8-49af-ab50-874700fd0046 tempest-VolumesGetTest-720043163 None] Lock "cinder-da441ccb-dbd0-446a-9a62-ec628b302462-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-quobyte-66c2dffe-8d29-431a-b6d6-4f51764046d6" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-66c2dffe-8d29-431a-b6d6-4f51764046d6" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cb9ceb-7cf6-48b2-a8d3-7c0cd065093a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:01 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 Nov 03 20:27:01 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:02 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 1073741824" returned: 0 in 0.595s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:02 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 Nov 03 20:27:02 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:02 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6" returned: 0 in 0.438s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:02 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6 Nov 03 20:27:02 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:02 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608" returned: 0 in 0.279s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Attempting download of 8d5e9d22-53f9-4650-9c19-050345b494a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d5e9d22-53f9-4650-9c19-050345b494a7', 'metadata': {}}])) to volume a7a511a3-64cc-4159-90a9-049f7c04d608. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69d45ca-8037-424c-9509-6b9eb9237ff0]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d5e9d22-53f9-4650-9c19-050345b494a7_f0mhmuvy {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Acquiring lock "cinder-f665ebdc-b107-4e2e-a0a0-a173f646cd43-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Lock "cinder-f665ebdc-b107-4e2e-a0a0-a173f646cd43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Acquiring lock "cinder-quobyte-fa04afdc-4781-4f94-881a-d8f75fe0523c" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Lock "cinder-quobyte-fa04afdc-4781-4f94-881a-d8f75fe0523c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Acquiring lock "cinder-quobyte-f665ebdc-b107-4e2e-a0a0-a173f646cd43" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Lock "cinder-quobyte-f665ebdc-b107-4e2e-a0a0-a173f646cd43" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:02 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Deleting offline snapshot f665ebdc-b107-4e2e-a0a0-a173f646cd43 of volume fa04afdc-4781-4f94-881a-d8f75fe0523c {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] snapshot_file for this snap is: volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-66c2dffe-8d29-431a-b6d6-4f51764046d6" returned: 0 in 0.401s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c68c65d-3fae-410b-9645-964a792d0b5e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-66c2dffe-8d29-431a-b6d6-4f51764046d6" released by "delete_volume" :: held 0.901s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:02 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d5e9d22-53f9-4650-9c19-050345b494a7_f0mhmuvy Nov 03 20:27:02 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Created reservations ['5df752f6-023a-47b6-90a0-1103e97f73af', 'e4cdce01-5f10-4c42-b480-17e7de7ebecc', '2fda6aca-2a1d-449f-9b2a-4363d6ccd8c7', '00b92485-a2b7-45cb-bdfc-f3a5d36f7253'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:02 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 Nov 03 20:27:02 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:02 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:02 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:02 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d5e9d22-53f9-4650-9c19-050345b494a7_f0mhmuvy" returned: 0 in 0.504s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d5e9d22-53f9-4650-9c19-050345b494a7_f0mhmuvy {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-f7ca74da-b603-4def-9e46-0c0888b68624-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Lock "cinder-f7ca74da-b603-4def-9e46-0c0888b68624-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-quobyte-f7ca74da-b603-4def-9e46-0c0888b68624" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:03 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d5e9d22-53f9-4650-9c19-050345b494a7_f0mhmuvy Nov 03 20:27:03 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-f7ca74da-b603-4def-9e46-0c0888b68624" acquired by "delete_volume" :: waited 0.034s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:03 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:03 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43" returned: 0 in 0.569s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa04afdc-4781-4f94-881a-d8f75fe0523c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40c4306-3e72-4d1d-9208-fdeaf3234054]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.405s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[795dc42d-b22a-4e36-8075-3d909d694b3b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:03 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Deleted volume successfully. Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-51bd01af-9a6d-41c4-9cc0-d45e9438db3f tempest-VolumesGetTest-720043163 None] Lock "cinder-66c2dffe-8d29-431a-b6d6-4f51764046d6-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:03 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c Nov 03 20:27:03 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:03 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d5e9d22-53f9-4650-9c19-050345b494a7_f0mhmuvy" returned: 1 in 0.454s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d5e9d22-53f9-4650-9c19-050345b494a7_f0mhmuvy' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:27:03 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 Nov 03 20:27:03 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9956fbc-e9af-4653-9676-cd5695861e81]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:03 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD Nov 03 20:27:03 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:03 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:03 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c" returned: 0 in 0.518s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624" returned: 0 in 0.548s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:03 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 Nov 03 20:27:03 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:03 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624 Nov 03 20:27:03 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:03 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:03 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD Nov 03 20:27:03 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:04 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f7ca74da-b603-4def-9e46-0c0888b68624" returned: 0 in 0.279s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-f7ca74da-b603-4def-9e46-0c0888b68624" released by "delete_volume" :: held 0.918s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Created reservations ['d694402d-971d-4fb5-a062-b5313d42f728', '0dd0a1d1-196b-4309-8189-54610fe24c13', '0cd8700b-81e6-46af-892a-96f4558caa28', 'ec1aba83-a7d4-4913-bab6-3f19a3ee06cc'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:04 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:04 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] 8d5e9d22-53f9-4650-9c19-050345b494a7 was raw, converting to qcow2 {{(pid=87342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:04 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:04 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43" returned: 0 in 0.510s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:04 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 Nov 03 20:27:04 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:04 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43 Nov 03 20:27:04 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:04 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.348s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Deleted volume successfully. Nov 03 20:27:04 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c.f665ebdc-b107-4e2e-a0a0-a173f646cd43" returned: 0 in 0.346s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ea76e1e6-6748-4b24-8340-14a55082e6f3 tempest-VolumesGetTest-720043163 None] Lock "cinder-f7ca74da-b603-4def-9e46-0c0888b68624-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Lock "cinder-quobyte-f665ebdc-b107-4e2e-a0a0-a173f646cd43" released by "_delete_snapshot" :: held 2.111s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Lock "cinder-quobyte-fa04afdc-4781-4f94-881a-d8f75fe0523c" released by "delete_snapshot" :: held 2.166s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Created reservations ['bf8b2f40-cb4b-4c51-9d7f-fc2b64eed19f', '7cc62e3f-d80f-47c5-a0e3-914c6e662177', '5e5cadaa-f504-4db7-847b-8c2eb7f6b83b', 'bfd8505e-48c1-42a3-a051-3b0538b48ca7'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Delete snapshot completed successfully. Nov 03 20:27:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5707dd60-67ac-43f1-8c92-40b34592af3c tempest-CinderUnicodeTest-601075759 None] Lock "cinder-f665ebdc-b107-4e2e-a0a0-a173f646cd43-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:05 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608" returned: 0 in 0.739s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d5e9d22-53f9-4650-9c19-050345b494a7_31vtkae4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:27:05 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:05 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 1G Nov 03 20:27:05 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (c01e72c9-1119-445d-b7c4-c9dc7a25d426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4518be88-e3b3-4d7d-8b8d-40da83455413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4518be88-e3b3-4d7d-8b8d-40da83455413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745944846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090c244c-4bc0-4cb4-b504-e75167a2898d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:05Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5761018f-a498-4c6d-b384-4f4661444c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5761018f-a498-4c6d-b384-4f4661444c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cbe2867-ea0f-4c47-b86c-6b732b46838b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.image.glance [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Creating Keystone auth plugin from conf {{(pid=87342) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:27:05 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 1G" returned: 0 in 0.449s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Downloaded image 8d5e9d22-53f9-4650-9c19-050345b494a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d5e9d22-53f9-4650-9c19-050345b494a7', 'metadata': {}}])) to volume a7a511a3-64cc-4159-90a9-049f7c04d608 successfully. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Temporary image 8d5e9d22-53f9-4650-9c19-050345b494a7 for user 778d705eaf5d4f57ab88b3fde15dc096 is deleted. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Marking volume a7a511a3-64cc-4159-90a9-049f7c04d608 as bootable. {{(pid=87342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Copying metadata from image 8d5e9d22-53f9-4650-9c19-050345b494a7 to a7a511a3-64cc-4159-90a9-049f7c04d608. {{(pid=87342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Creating volume glance metadata for volume a7a511a3-64cc-4159-90a9-049f7c04d608 backed by image 8d5e9d22-53f9-4650-9c19-050345b494a7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8d5e9d22-53f9-4650-9c19-050345b494a7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '78aa9c2828bf581135890994424b6fc8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b2c15a-a693-4419-b71c-32627ba1a94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7a511a3-64cc-4159-90a9-049f7c04d608', 'volume_size': 1, 'image_id': '8d5e9d22-53f9-4650-9c19-050345b494a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d5e9d22-53f9-4650-9c19-050345b494a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78aa9c2828bf581135890994424b6fc8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3200a233b02d4215b68dda75143b7f73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da9bba193156731522c1d102565573d25c7d4f8ce0dda754ca07d3b09656149816be7e458e0ba1fb560bbd16a18729c66334ca3fbce4716a6a8a1549cae05b9f', 'id': '8d5e9d22-53f9-4650-9c19-050345b494a7', 'created_at': datetime.datetime(2026, 11, 3, 19, 26, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 26, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d5e9d22-53f9-4650-9c19-050345b494a7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f76ddee-b929-4117-b9e6-125d6b353d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:05 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Volume volume-a7a511a3-64cc-4159-90a9-049f7c04d608 (a7a511a3-64cc-4159-90a9-049f7c04d608): created successfully Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f76ddee-b929-4117-b9e6-125d6b353d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Flow 'volume_create_manager' (cd4e7266-6e6e-4fe0-882f-23fd7a1a870f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:05 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-9df3311c-2af5-4261-95ca-9ac500ecdd06 tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Created volume successfully. Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Acquiring lock "cinder-fa04afdc-4781-4f94-881a-d8f75fe0523c-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cbe2867-ea0f-4c47-b86c-6b732b46838b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '090c244c-4bc0-4cb4-b504-e75167a2898d', 'volume_name': 'volume-090c244c-4bc0-4cb4-b504-e75167a2898d', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dc0d5c-782f-4da6-8061-0394d22c4fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dc0d5c-782f-4da6-8061-0394d22c4fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03b56f1-2fb4-4453-a6a5-41281273f7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:05 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Volume 090c244c-4bc0-4cb4-b504-e75167a2898d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-090c244c-4bc0-4cb4-b504-e75167a2898d', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Trying to clone 090c244c-4bc0-4cb4-b504-e75167a2898d from image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 at location (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]). {{(pid=87342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Lock "cinder-fa04afdc-4781-4f94-881a-d8f75fe0523c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Acquiring lock "cinder-quobyte-fa04afdc-4781-4f94-881a-d8f75fe0523c" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Lock "cinder-quobyte-fa04afdc-4781-4f94-881a-d8f75fe0523c" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d022831-c75d-4a58-b335-16a3abef1635]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Acquiring lock "cinder-a7a511a3-64cc-4159-90a9-049f7c04d608-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Lock "cinder-a7a511a3-64cc-4159-90a9-049f7c04d608-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:06 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c Nov 03 20:27:06 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Acquiring lock "cinder-quobyte-a7a511a3-64cc-4159-90a9-049f7c04d608" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Lock "cinder-quobyte-a7a511a3-64cc-4159-90a9-049f7c04d608" acquired by "delete_volume" :: waited 0.031s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[54440a51-4562-4c93-b375-18461eeb0cb5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:27:06 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Image download 20.69 MB at 20.69 MB/s Nov 03 20:27:06 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 Nov 03 20:27:06 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fb527e-9728-4c92-af47-dda1489b7a96]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:06 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c" returned: 0 in 0.570s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:06 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c Nov 03 20:27:06 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:06 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD Nov 03 20:27:06 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:06 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608" returned: 0 in 0.540s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:06 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:06 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608 Nov 03 20:27:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fa04afdc-4781-4f94-881a-d8f75fe0523c" returned: 0 in 0.339s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:06 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Lock "cinder-quobyte-fa04afdc-4781-4f94-881a-d8f75fe0523c" released by "delete_volume" :: held 1.104s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Created reservations ['cd1c0527-f766-4be2-a7f7-801d4bf5df96', '35707da2-b749-47a8-befb-4739a4233e21', '98590c57-fb81-4957-8cd3-c3eb8101564f', '03cf3ba1-7ddc-4fd0-9284-ee46bc4973f6'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:07 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD" returned: 0 in 0.622s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Temporary image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 is fetched for user d0b44e1fe7164187bdeb26be2fa1f02f. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:27:07 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a7a511a3-64cc-4159-90a9-049f7c04d608" returned: 0 in 0.373s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Lock "cinder-quobyte-a7a511a3-64cc-4159-90a9-049f7c04d608" released by "delete_volume" :: held 0.992s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:07 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:07 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[73351d04-c135-4f46-b16a-d164189e830a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:07 devstack cinder-volume[87342]: WARNING cinder.quota [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:27:07 devstack cinder-volume[87342]: WARNING cinder.quota [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Created reservations ['185035cb-c99a-4e68-a135-6d596358699c', '715a7e19-932a-4e31-a5d7-4f0e789ee281', '564432a4-d547-485d-bd65-1453d2359dcc', 'f3c533c9-0b5c-4fe7-859e-51f54f9c0e67'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:07 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD Nov 03 20:27:07 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:07 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:07 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:07 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.429s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:07 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Deleted volume successfully. Nov 03 20:27:07 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745944846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090c244c-4bc0-4cb4-b504-e75167a2898d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:05Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Creating volume 090c244c-4bc0-4cb4-b504-e75167a2898d {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:07 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61acd3a5-1cb9-44e0-87c5-c733a6f1a421 tempest-CinderUnicodeTest-601075759 None] Lock "cinder-fa04afdc-4781-4f94-881a-d8f75fe0523c-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:07 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d 1073741824 Nov 03 20:27:07 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:08 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.337s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:08 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Deleted volume successfully. Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96d8d0b6-2d6b-4125-b9b6-c564c8ee443b tempest-VolumeAndVolumeTypeFromImageTest-357030448 None] Lock "cinder-a7a511a3-64cc-4159-90a9-049f7c04d608-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Acquiring lock "cinder-16418a37-58fc-4580-9ad9-5deca437d8a9-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Lock "cinder-16418a37-58fc-4580-9ad9-5deca437d8a9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Acquiring lock "cinder-quobyte-16418a37-58fc-4580-9ad9-5deca437d8a9" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Lock "cinder-quobyte-16418a37-58fc-4580-9ad9-5deca437d8a9" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f61592d-0c9f-403e-8d8e-327f6a6ac465]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:08 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9 Nov 03 20:27:08 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:08 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d 1073741824" returned: 0 in 0.738s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:08 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d Nov 03 20:27:08 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:08 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9" returned: 0 in 0.519s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:08 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9 Nov 03 20:27:08 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:09 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d" returned: 0 in 0.340s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Attempting download of 82b2f310-b2ab-4d6d-9d32-5c0ace417816 ((None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}])) to volume 090c244c-4bc0-4cb4-b504-e75167a2898d. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9871e7-6547-4fc2-8829-e8a45c69f3c4]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_611rtyzw {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:09 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16418a37-58fc-4580-9ad9-5deca437d8a9" returned: 0 in 0.387s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Lock "cinder-quobyte-16418a37-58fc-4580-9ad9-5deca437d8a9" released by "delete_volume" :: held 0.971s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Created reservations ['2f12039d-557e-4f30-91b4-98d5c455462c', 'ca8d7a07-61cb-4fab-8936-de78da09d825', '7cf69f3c-cc6c-4df7-9346-7ba35c485ca9', '11146d2e-9b35-4230-977f-266f65742afe'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:09 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_611rtyzw Nov 03 20:27:09 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:09 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:09 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:09 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_611rtyzw" returned: 0 in 0.445s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_611rtyzw {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:09 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.321s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:09 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Deleted volume successfully. Nov 03 20:27:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c08fbaf8-f9af-46f4-96cd-808489a563fb tempest-CinderUnicodeTest-601075759 None] Lock "cinder-16418a37-58fc-4580-9ad9-5deca437d8a9-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:09 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_611rtyzw Nov 03 20:27:09 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:10 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_611rtyzw" returned: 1 in 0.426s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_611rtyzw' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:27:10 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc4990a-05ae-4bf6-8d82-8771673311d9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:10 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD Nov 03 20:27:10 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:10 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:10 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] 82b2f310-b2ab-4d6d-9d32-5c0ace417816 was qcow2, converting to qcow2 {{(pid=87342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:27:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:10 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d Nov 03 20:27:10 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:13 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d" returned: 0 in 2.866s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_j04benkfdevstack@QuobyteHD, size 112.00 MB, duration 2.87 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:27:13 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Converted 112.00 MB image at 39.05 MB/s Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:13 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d 1G Nov 03 20:27:13 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:13 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d 1G" returned: 0 in 0.470s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Downloaded image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 ((None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}])) to volume 090c244c-4bc0-4cb4-b504-e75167a2898d successfully. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Temporary image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 for user d0b44e1fe7164187bdeb26be2fa1f02f is deleted. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Marking volume 090c244c-4bc0-4cb4-b504-e75167a2898d as bootable. {{(pid=87342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Copying metadata from image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 to 090c244c-4bc0-4cb4-b504-e75167a2898d. {{(pid=87342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Creating volume glance metadata for volume 090c244c-4bc0-4cb4-b504-e75167a2898d backed by image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03b56f1-2fb4-4453-a6a5-41281273f7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090c244c-4bc0-4cb4-b504-e75167a2898d', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc159bb9-0879-409d-a58a-25cdf3075543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:13 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Volume volume-090c244c-4bc0-4cb4-b504-e75167a2898d (090c244c-4bc0-4cb4-b504-e75167a2898d): created successfully Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc159bb9-0879-409d-a58a-25cdf3075543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (c01e72c9-1119-445d-b7c4-c9dc7a25d426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:14 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-62afb40a-6caf-416f-a72c-85b1cd5fe086 tempest-VolumesGetTest-720043163 None] Created volume successfully. Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (2a9ae30f-67ad-4a1f-a9d6-59f509633f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6051453-b181-4866-a2a8-6cfbbec567ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6051453-b181-4866-a2a8-6cfbbec567ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1561581745',display_name='tempest-VolumesGetTest-Volume-1819393715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18a1682-87a5-4e44-be7f-89331539302a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:15Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46c8627-dc78-4395-96e9-9b74bf390082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46c8627-dc78-4395-96e9-9b74bf390082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8138e6-9bd0-4582-b5f3-7221a2f4fcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8138e6-9bd0-4582-b5f3-7221a2f4fcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a18a1682-87a5-4e44-be7f-89331539302a', 'volume_name': 'volume-a18a1682-87a5-4e44-be7f-89331539302a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d3a71a-66cc-4fbd-a847-d6e7a2806bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d3a71a-66cc-4fbd-a847-d6e7a2806bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80d0152-4147-43aa-b65f-0f8d2d472112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Volume a18a1682-87a5-4e44-be7f-89331539302a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a18a1682-87a5-4e44-be7f-89331539302a', 'volume_size': 1} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1561581745',display_name='tempest-VolumesGetTest-Volume-1819393715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18a1682-87a5-4e44-be7f-89331539302a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fc08f524814958bc32b89a2bc71e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:15Z,use_quota=True,user_id='d0b44e1fe7164187bdeb26be2fa1f02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Creating volume a18a1682-87a5-4e44-be7f-89331539302a {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:15 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:15 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a 1073741824 Nov 03 20:27:15 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Flow 'volume_create_manager' (8d599c2b-ebdb-42ff-bda8-e0f50c301ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac55966-64ce-4b8a-908e-cce5f9bcb0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac55966-64ce-4b8a-908e-cce5f9bcb0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1582550545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549bec51-a635-411c-aa10-c20b0187d9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9918f20a37d64872b3ff1dda773070c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:15Z,use_quota=True,user_id='7a379975f6d44d66b1bd4de06253f483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c746fb13-9883-4edc-85a3-e737e68ccbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c746fb13-9883-4edc-85a3-e737e68ccbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b87778-3f56-4c1b-b2f5-bf42e6e7d3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b87778-3f56-4c1b-b2f5-bf42e6e7d3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549bec51-a635-411c-aa10-c20b0187d9c8', 'volume_name': 'volume-549bec51-a635-411c-aa10-c20b0187d9c8', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c11bcb5-fbb1-4b0b-a71e-36d08ad8379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c11bcb5-fbb1-4b0b-a71e-36d08ad8379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3ce168-bac0-444d-9977-05917e7902fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Volume 549bec51-a635-411c-aa10-c20b0187d9c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549bec51-a635-411c-aa10-c20b0187d9c8', 'volume_size': 1} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Flow 'volume_create_manager' (e71a0abe-7596-4d3b-a13f-74b251bfb22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a9937c-d479-4813-9466-098bf0662b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a9937c-d479-4813-9466-098bf0662b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1170785039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab013805-6093-4360-9197-710bf8bfb684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9918f20a37d64872b3ff1dda773070c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:16Z,use_quota=True,user_id='7a379975f6d44d66b1bd4de06253f483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d531076d-5706-4191-8130-06c7ec888654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d531076d-5706-4191-8130-06c7ec888654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9c375d-dc27-4cfd-a618-84a4db381802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9c375d-dc27-4cfd-a618-84a4db381802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab013805-6093-4360-9197-710bf8bfb684', 'volume_name': 'volume-ab013805-6093-4360-9197-710bf8bfb684', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d687d13-3605-4b40-8d6b-9fc7dd586702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d687d13-3605-4b40-8d6b-9fc7dd586702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fb4443-6336-4a24-8c0d-12f3292c3a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Volume ab013805-6093-4360-9197-710bf8bfb684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab013805-6093-4360-9197-710bf8bfb684', 'volume_size': 1} Nov 03 20:27:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Flow 'volume_create_manager' (e01232fa-0cf5-4476-a8ac-d57110729cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dab60f1-75cd-4211-bdeb-b53e3af38110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dab60f1-75cd-4211-bdeb-b53e3af38110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1875827907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf4aa7f-d874-4b70-9219-12b5b2dfdb42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9918f20a37d64872b3ff1dda773070c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:16Z,use_quota=True,user_id='7a379975f6d44d66b1bd4de06253f483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d164c45d-9c4b-45ba-8f30-3e5642ae5041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d164c45d-9c4b-45ba-8f30-3e5642ae5041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbcc6a5-fbc8-4d73-ad11-4544b5353853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbcc6a5-fbc8-4d73-ad11-4544b5353853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf4aa7f-d874-4b70-9219-12b5b2dfdb42', 'volume_name': 'volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998c69f4-c084-4c7b-8f98-12f9582c5e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998c69f4-c084-4c7b-8f98-12f9582c5e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a3a37b-430c-426d-9fde-32b0fc2084be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:16 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Volume 1cf4aa7f-d874-4b70-9219-12b5b2dfdb42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42', 'volume_size': 1} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:16 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a 1073741824" returned: 0 in 0.817s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:16 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a Nov 03 20:27:16 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:16 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a" returned: 0 in 0.364s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.082s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1582550545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549bec51-a635-411c-aa10-c20b0187d9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9918f20a37d64872b3ff1dda773070c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:15Z,use_quota=True,user_id='7a379975f6d44d66b1bd4de06253f483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Creating volume 549bec51-a635-411c-aa10-c20b0187d9c8 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:16 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:16 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8 1073741824 Nov 03 20:27:16 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80d0152-4147-43aa-b65f-0f8d2d472112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a18a1682-87a5-4e44-be7f-89331539302a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4715a80d-4ab0-47cf-bf6c-af5a8d9c7fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:16 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Volume volume-a18a1682-87a5-4e44-be7f-89331539302a (a18a1682-87a5-4e44-be7f-89331539302a): created successfully Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4715a80d-4ab0-47cf-bf6c-af5a8d9c7fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Flow 'volume_create_manager' (2a9ae30f-67ad-4a1f-a9d6-59f509633f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Flow 'volume_create_manager' (a82ae27d-25a0-4f3a-9a3d-d51321628586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5030426d-360c-49d5-bd02-572bb81867df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5030426d-360c-49d5-bd02-572bb81867df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-332773620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651dcf03-116c-4b9c-b25f-654e2e65e836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9918f20a37d64872b3ff1dda773070c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:17Z,use_quota=True,user_id='7a379975f6d44d66b1bd4de06253f483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd8e815-66f6-4c3f-880a-3529f89855e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd8e815-66f6-4c3f-880a-3529f89855e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b449319-e535-455f-9e5e-46f2881f3b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b449319-e535-455f-9e5e-46f2881f3b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651dcf03-116c-4b9c-b25f-654e2e65e836', 'volume_name': 'volume-651dcf03-116c-4b9c-b25f-654e2e65e836', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4d904a-bac3-4c43-bcac-30c7e7d72511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4d904a-bac3-4c43-bcac-30c7e7d72511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0a3859-7768-4f88-a56f-c2d965dccaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:16 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Volume 651dcf03-116c-4b9c-b25f-654e2e65e836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651dcf03-116c-4b9c-b25f-654e2e65e836', 'volume_size': 1} Nov 03 20:27:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:16 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2496a9ac-2ccc-47b2-95a7-08b65941c10f tempest-VolumesGetTest-720043163 None] Created volume successfully. Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-a18a1682-87a5-4e44-be7f-89331539302a-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Lock "cinder-a18a1682-87a5-4e44-be7f-89331539302a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Flow 'volume_create_manager' (36694e71-ef26-454e-a6a4-fda4ef2f4e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:17 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a8707f-359d-406a-bfbd-f0bf94347e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8 1073741824" returned: 0 in 0.856s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a8707f-359d-406a-bfbd-f0bf94347e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1311542030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24582697-b8ab-4898-b59d-58392fd290dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9918f20a37d64872b3ff1dda773070c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:17Z,use_quota=True,user_id='7a379975f6d44d66b1bd4de06253f483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62c0fcc-b761-4ab8-86e1-168340524062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62c0fcc-b761-4ab8-86e1-168340524062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d19e28-e29d-4843-af90-0609979ce2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d19e28-e29d-4843-af90-0609979ce2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24582697-b8ab-4898-b59d-58392fd290dd', 'volume_name': 'volume-24582697-b8ab-4898-b59d-58392fd290dd', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395a6d6b-ba85-4a19-b995-caa98bb842ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395a6d6b-ba85-4a19-b995-caa98bb842ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d913cc64-01c7-4922-8967-eebfe2532cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:17 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Volume 24582697-b8ab-4898-b59d-58392fd290dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24582697-b8ab-4898-b59d-58392fd290dd', 'volume_size': 1} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-quobyte-a18a1682-87a5-4e44-be7f-89331539302a" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-a18a1682-87a5-4e44-be7f-89331539302a" acquired by "delete_volume" :: waited 0.040s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:17 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8 Nov 03 20:27:17 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6a4643-e091-4339-934c-1b39c4d4da95]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:17 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a Nov 03 20:27:17 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:17 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8" returned: 0 in 0.303s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.245s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1170785039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab013805-6093-4360-9197-710bf8bfb684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9918f20a37d64872b3ff1dda773070c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:16Z,use_quota=True,user_id='7a379975f6d44d66b1bd4de06253f483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Creating volume ab013805-6093-4360-9197-710bf8bfb684 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:18 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3ce168-bac0-444d-9977-05917e7902fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549bec51-a635-411c-aa10-c20b0187d9c8', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92f2449-5070-4a89-b8a4-8b039558fbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:18 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684 1073741824 Nov 03 20:27:18 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:18 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Volume volume-549bec51-a635-411c-aa10-c20b0187d9c8 (549bec51-a635-411c-aa10-c20b0187d9c8): created successfully Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92f2449-5070-4a89-b8a4-8b039558fbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Flow 'volume_create_manager' (8d599c2b-ebdb-42ff-bda8-e0f50c301ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:18 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-dff73213-d497-4c0c-a795-07838b924ccb tempest-CreateVolumesFromImageTest-2141443462 None] Created volume successfully. Nov 03 20:27:18 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a" returned: 0 in 0.550s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:18 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a Nov 03 20:27:18 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:18 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a18a1682-87a5-4e44-be7f-89331539302a" returned: 0 in 0.381s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:18 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-a18a1682-87a5-4e44-be7f-89331539302a" released by "delete_volume" :: held 1.014s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684 1073741824" returned: 0 in 0.707s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:18 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684 Nov 03 20:27:18 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Created reservations ['1c120011-b7c3-4024-8d27-9a964aeaa1d9', 'c913738f-3679-4ef1-9858-6b4e662cce47', 'dedab5c5-69c6-4da0-9461-605a21b08ec9', 'ab7ce1f1-8304-4ecd-95ff-635798723c29'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:19 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:19 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:19 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684" returned: 0 in 0.368s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.933s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1875827907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf4aa7f-d874-4b70-9219-12b5b2dfdb42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9918f20a37d64872b3ff1dda773070c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:16Z,use_quota=True,user_id='7a379975f6d44d66b1bd4de06253f483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Creating volume 1cf4aa7f-d874-4b70-9219-12b5b2dfdb42 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:19 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fb4443-6336-4a24-8c0d-12f3292c3a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab013805-6093-4360-9197-710bf8bfb684', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab53929a-3473-4098-9591-8637863ae061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:19 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42 1073741824 Nov 03 20:27:19 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:19 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Volume volume-ab013805-6093-4360-9197-710bf8bfb684 (ab013805-6093-4360-9197-710bf8bfb684): created successfully Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab53929a-3473-4098-9591-8637863ae061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Flow 'volume_create_manager' (e71a0abe-7596-4d3b-a13f-74b251bfb22e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:19 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-473c792d-b8f8-4c82-9092-0ced0621fecd tempest-CreateVolumesFromImageTest-2141443462 None] Created volume successfully. Nov 03 20:27:19 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.357s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:19 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Deleted volume successfully. Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7f5ff3f-17b3-46db-bf3a-805227fb33b0 tempest-VolumesGetTest-720043163 None] Lock "cinder-a18a1682-87a5-4e44-be7f-89331539302a-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:19 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42 1073741824" returned: 0 in 0.735s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-090c244c-4bc0-4cb4-b504-e75167a2898d-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Lock "cinder-090c244c-4bc0-4cb4-b504-e75167a2898d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:20 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42 Nov 03 20:27:20 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Acquiring lock "cinder-quobyte-090c244c-4bc0-4cb4-b504-e75167a2898d" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-090c244c-4bc0-4cb4-b504-e75167a2898d" acquired by "delete_volume" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b32ef10-c6c5-4e1f-b946-52518d49fb2b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:20 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d Nov 03 20:27:20 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:20 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42" returned: 0 in 0.412s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.450s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-332773620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651dcf03-116c-4b9c-b25f-654e2e65e836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9918f20a37d64872b3ff1dda773070c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:17Z,use_quota=True,user_id='7a379975f6d44d66b1bd4de06253f483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Creating volume 651dcf03-116c-4b9c-b25f-654e2e65e836 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:20 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a3a37b-430c-426d-9fde-32b0fc2084be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:20 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836 1073741824 Nov 03 20:27:20 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0588ec09-c1cf-462d-bea6-52ccfd2fc52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:20 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Volume volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42 (1cf4aa7f-d874-4b70-9219-12b5b2dfdb42): created successfully Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0588ec09-c1cf-462d-bea6-52ccfd2fc52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Flow 'volume_create_manager' (e01232fa-0cf5-4476-a8ac-d57110729cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:20 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0b860d3c-b342-40bb-ad06-9ecfb258e77c tempest-CreateVolumesFromImageTest-2141443462 None] Created volume successfully. Nov 03 20:27:20 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d" returned: 0 in 0.628s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:20 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d Nov 03 20:27:20 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:21 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836 1073741824" returned: 0 in 0.643s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:21 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-090c244c-4bc0-4cb4-b504-e75167a2898d" returned: 0 in 0.339s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Lock "cinder-quobyte-090c244c-4bc0-4cb4-b504-e75167a2898d" released by "delete_volume" :: held 1.052s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:21 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836 Nov 03 20:27:21 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Created reservations ['0dadb0a1-4d99-4a16-95de-4775467b6711', '98e0f5db-ea67-489e-b7fc-85ae29219a68', '2366a9b7-961d-4cc2-8cde-ccbb548386f1', '7c53231d-adb0-428b-add6-d0acd237a9a4'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:21 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:21 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:21 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836" returned: 0 in 0.327s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.857s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1311542030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24582697-b8ab-4898-b59d-58392fd290dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9918f20a37d64872b3ff1dda773070c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:17Z,use_quota=True,user_id='7a379975f6d44d66b1bd4de06253f483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Creating volume 24582697-b8ab-4898-b59d-58392fd290dd {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:21 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0a3859-7768-4f88-a56f-c2d965dccaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651dcf03-116c-4b9c-b25f-654e2e65e836', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd241ded-e7bd-4ad6-9489-b78ee24a2a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:21 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd 1073741824 Nov 03 20:27:21 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:21 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Volume volume-651dcf03-116c-4b9c-b25f-654e2e65e836 (651dcf03-116c-4b9c-b25f-654e2e65e836): created successfully Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd241ded-e7bd-4ad6-9489-b78ee24a2a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Flow 'volume_create_manager' (a82ae27d-25a0-4f3a-9a3d-d51321628586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:21 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8b5c45ed-a7c7-4d24-9193-faa72f2d7b18 tempest-CreateVolumesFromImageTest-2141443462 None] Created volume successfully. Nov 03 20:27:21 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.351s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:21 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Deleted volume successfully. Nov 03 20:27:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f269a93f-4200-41f5-8358-3d203055d047 tempest-VolumesGetTest-720043163 None] Lock "cinder-090c244c-4bc0-4cb4-b504-e75167a2898d-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:22 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd 1073741824" returned: 0 in 0.620s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:22 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd Nov 03 20:27:22 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:22 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd" returned: 0 in 0.411s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d913cc64-01c7-4922-8967-eebfe2532cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24582697-b8ab-4898-b59d-58392fd290dd', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5053d3fc-e3e9-4eb2-a7df-2a25d6609977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:22 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Volume volume-24582697-b8ab-4898-b59d-58392fd290dd (24582697-b8ab-4898-b59d-58392fd290dd): created successfully Nov 03 20:27:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5053d3fc-e3e9-4eb2-a7df-2a25d6609977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Flow 'volume_create_manager' (36694e71-ef26-454e-a6a4-fda4ef2f4e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:22 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7868bd1b-493f-4daa-9f82-d27eb4166712 tempest-CreateVolumesFromImageTest-2141443462 None] Created volume successfully. Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "cinder-24582697-b8ab-4898-b59d-58392fd290dd-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-24582697-b8ab-4898-b59d-58392fd290dd-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "cinder-quobyte-24582697-b8ab-4898-b59d-58392fd290dd" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-quobyte-24582697-b8ab-4898-b59d-58392fd290dd" acquired by "delete_volume" :: waited 0.037s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ff36a8-83a1-4df2-84f5-137984475d87]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:23 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:23 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:23 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd Nov 03 20:27:23 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:24 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.613s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:27:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:27:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:27:24 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd" returned: 0 in 0.851s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:24 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd Nov 03 20:27:24 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:24 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-24582697-b8ab-4898-b59d-58392fd290dd" returned: 0 in 0.323s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-quobyte-24582697-b8ab-4898-b59d-58392fd290dd" released by "delete_volume" :: held 1.303s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:24 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Created reservations ['d6cca919-d2d8-472c-ae19-4f9e2e4fa64a', '476091ba-b6d7-4187-bdbe-eb04a9fbd54c', 'b55b74d4-fdc2-457b-9a0e-521f9a1f93a1', 'd0dcf2ef-6a79-46cb-8e17-4ae0c63d866c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:25 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:25 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:25 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.384s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Deleted volume successfully. Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8e09539f-4c77-48a2-baa5-6f655dc0156f tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-24582697-b8ab-4898-b59d-58392fd290dd-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "cinder-651dcf03-116c-4b9c-b25f-654e2e65e836-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-651dcf03-116c-4b9c-b25f-654e2e65e836-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "cinder-quobyte-651dcf03-116c-4b9c-b25f-654e2e65e836" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-quobyte-651dcf03-116c-4b9c-b25f-654e2e65e836" acquired by "delete_volume" :: waited 0.048s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:26 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6757388-a194-4b6a-8154-962075b8a0e1]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:26 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836 Nov 03 20:27:26 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:26 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836" returned: 0 in 0.716s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:26 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836 Nov 03 20:27:26 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:27 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-651dcf03-116c-4b9c-b25f-654e2e65e836" returned: 0 in 0.574s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-quobyte-651dcf03-116c-4b9c-b25f-654e2e65e836" released by "delete_volume" :: held 1.379s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:27 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Created reservations ['91321b68-6f6d-46ad-9222-193b7e8cff00', '55686b55-f0fd-4291-9940-4daed0752d48', 'd67a6bc0-53e7-4c47-98f8-91f4771fc2c5', 'd9364b5e-43b3-48ed-ba3b-abd5bf2c2f28'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:27 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:27 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "cinder-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:28 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.649s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:28 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:28 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Deleted volume successfully. Nov 03 20:27:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a7bd3906-fd5f-4bf0-8ae8-977cc6d7f1f1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-651dcf03-116c-4b9c-b25f-654e2e65e836-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "cinder-quobyte-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-quobyte-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42" acquired by "delete_volume" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:28 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bd7456-8b75-4367-a6cc-fae1563556d9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:28 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42 Nov 03 20:27:28 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:29 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42" returned: 0 in 0.482s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:29 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42 Nov 03 20:27:29 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:29 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42" returned: 0 in 0.499s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-quobyte-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42" released by "delete_volume" :: held 1.093s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:29 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Created reservations ['53795b1e-e2d9-4fd6-8b98-e5292736f9c3', 'd38e9943-7859-439c-a893-9e28180eec2e', '35c90e9a-3dd8-476a-bcd1-2b8f5c866b74', '025e640b-d3ba-4b82-94fc-f657faff62d5'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:29 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:29 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:30 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.404s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:30 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Deleted volume successfully. Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f7ea6e10-8b5e-4a87-84fc-b4036580a4d1 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-1cf4aa7f-d874-4b70-9219-12b5b2dfdb42-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "cinder-ab013805-6093-4360-9197-710bf8bfb684-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-ab013805-6093-4360-9197-710bf8bfb684-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "cinder-quobyte-ab013805-6093-4360-9197-710bf8bfb684" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-quobyte-ab013805-6093-4360-9197-710bf8bfb684" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5805d228-02ae-448a-a0fa-0efe9f51804c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Flow 'volume_create_manager' (f6e6c06e-9b20-4f56-8618-0f485e7565c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61575d3e-42fa-46ce-b8e8-f70dc5839c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61575d3e-42fa-46ce-b8e8-f70dc5839c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-779210058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd37217-8f12-432a-b009-082bae625ff0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a7c54531e4330ab97e09a7fa8010d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:31Z,use_quota=True,user_id='12685fde24014db8855af6a4a7277eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde68386-3b7f-4ced-bc1d-53392c6366cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde68386-3b7f-4ced-bc1d-53392c6366cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5274928-fe85-4f4c-8bca-64b1c301748a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5274928-fe85-4f4c-8bca-64b1c301748a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd37217-8f12-432a-b009-082bae625ff0', 'volume_name': 'volume-bcd37217-8f12-432a-b009-082bae625ff0', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b612fe6-c2fc-444c-bce6-42e6bd941ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b612fe6-c2fc-444c-bce6-42e6bd941ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5ac69f-90e6-4b90-b3d1-5e40944612e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:30 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Volume bcd37217-8f12-432a-b009-082bae625ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd37217-8f12-432a-b009-082bae625ff0', 'volume_size': 1} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-779210058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd37217-8f12-432a-b009-082bae625ff0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a7c54531e4330ab97e09a7fa8010d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:31Z,use_quota=True,user_id='12685fde24014db8855af6a4a7277eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Creating volume bcd37217-8f12-432a-b009-082bae625ff0 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:31 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:31 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684 Nov 03 20:27:31 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:31 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0 1073741824 Nov 03 20:27:31 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:31 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684" returned: 0 in 0.410s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:31 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684 Nov 03 20:27:31 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:31 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0 1073741824" returned: 0 in 0.469s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:31 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0 Nov 03 20:27:31 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:31 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ab013805-6093-4360-9197-710bf8bfb684" returned: 0 in 0.295s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-quobyte-ab013805-6093-4360-9197-710bf8bfb684" released by "delete_volume" :: held 0.766s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Created reservations ['599c1ecc-47b3-4ff6-bf4f-8053ad19b7a2', 'baf5f8d9-c945-440d-b1d8-c87859b87c95', 'b14fa5d1-d0b0-4fcc-8fba-648c67647a2f', '16638bb0-2604-4f36-b7ab-ccf0c0c96534'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:31 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:31 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:31 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0" returned: 0 in 0.282s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5ac69f-90e6-4b90-b3d1-5e40944612e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd37217-8f12-432a-b009-082bae625ff0', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552497ed-8bd7-4c5f-9daf-649bda11ae00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:31 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Volume volume-bcd37217-8f12-432a-b009-082bae625ff0 (bcd37217-8f12-432a-b009-082bae625ff0): created successfully Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552497ed-8bd7-4c5f-9daf-649bda11ae00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Flow 'volume_create_manager' (f6e6c06e-9b20-4f56-8618-0f485e7565c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:31 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2b1aedcc-16ab-4e44-a1b4-e89b7a99b415 tempest-VolumesListTestJSON-58674333 None] Created volume successfully. Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "cinder-549bec51-a635-411c-aa10-c20b0187d9c8-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-549bec51-a635-411c-aa10-c20b0187d9c8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "cinder-quobyte-549bec51-a635-411c-aa10-c20b0187d9c8" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:32 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.288s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-quobyte-549bec51-a635-411c-aa10-c20b0187d9c8" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:32 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Deleted volume successfully. Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3aea4e-4d6b-4f04-8dd7-af65a7a897f3]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f1abbd36-3109-48d2-b6e4-092eb26eee02 tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-ab013805-6093-4360-9197-710bf8bfb684-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:32 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8 Nov 03 20:27:32 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:32 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8" returned: 0 in 0.378s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:32 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8 Nov 03 20:27:32 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:32 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-549bec51-a635-411c-aa10-c20b0187d9c8" returned: 0 in 0.281s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-quobyte-549bec51-a635-411c-aa10-c20b0187d9c8" released by "delete_volume" :: held 0.714s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Created reservations ['fa5c05d4-80db-4e10-87e3-82683f39850b', '46e452de-0e6c-49bc-bec8-68bfd57918cf', '8adc2e0d-28e2-4a53-a0a6-93871c63ee36', '941e626f-b2d5-4ab4-9294-4652c251e9a2'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:32 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:32 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:33 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.280s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:33 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Deleted volume successfully. Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c844173f-62c6-4242-b01e-553bf7a18b3c tempest-CreateVolumesFromImageTest-2141443462 None] Lock "cinder-549bec51-a635-411c-aa10-c20b0187d9c8-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Flow 'volume_create_manager' (99deb74b-a699-4f79-a5d7-74684bf23bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dba1ba1-50c8-455e-941c-26f52f9e3015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dba1ba1-50c8-455e-941c-26f52f9e3015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-470911539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff019fea-475d-4183-85d4-0aed9cb46d4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a7c54531e4330ab97e09a7fa8010d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:34Z,use_quota=True,user_id='12685fde24014db8855af6a4a7277eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cedec0-42c8-4d34-9f3f-7f8805ebeab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cedec0-42c8-4d34-9f3f-7f8805ebeab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ffb0bc-b828-4e10-9b85-3a0ed0f226db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ffb0bc-b828-4e10-9b85-3a0ed0f226db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff019fea-475d-4183-85d4-0aed9cb46d4b', 'volume_name': 'volume-ff019fea-475d-4183-85d4-0aed9cb46d4b', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149a9849-0a46-4bc7-8bb9-0faecd80a247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149a9849-0a46-4bc7-8bb9-0faecd80a247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46382517-141b-4ea6-a4c9-3a52a77b0d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:33 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Volume ff019fea-475d-4183-85d4-0aed9cb46d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff019fea-475d-4183-85d4-0aed9cb46d4b', 'volume_size': 1} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-470911539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff019fea-475d-4183-85d4-0aed9cb46d4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a7c54531e4330ab97e09a7fa8010d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:34Z,use_quota=True,user_id='12685fde24014db8855af6a4a7277eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Creating volume ff019fea-475d-4183-85d4-0aed9cb46d4b {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:33 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:33 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b 1073741824 Nov 03 20:27:33 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:34 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b 1073741824" returned: 0 in 0.516s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:34 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b Nov 03 20:27:34 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:34 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b" returned: 0 in 0.342s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46382517-141b-4ea6-a4c9-3a52a77b0d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff019fea-475d-4183-85d4-0aed9cb46d4b', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8db8cc0-26e1-4bd7-b863-ea6154765874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:34 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Volume volume-ff019fea-475d-4183-85d4-0aed9cb46d4b (ff019fea-475d-4183-85d4-0aed9cb46d4b): created successfully Nov 03 20:27:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8db8cc0-26e1-4bd7-b863-ea6154765874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Flow 'volume_create_manager' (99deb74b-a699-4f79-a5d7-74684bf23bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:34 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-45772d30-6bd9-4198-b390-cdc266002df4 tempest-VolumesListTestJSON-58674333 None] Created volume successfully. Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Flow 'volume_create_manager' (21238bfc-b299-4894-86bf-2890c988da67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee53daa1-47da-4307-b4a4-a11ee6887383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee53daa1-47da-4307-b4a4-a11ee6887383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-543129174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85df12a6-9a8f-4553-ba3d-853db79066ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a7c54531e4330ab97e09a7fa8010d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:36Z,use_quota=True,user_id='12685fde24014db8855af6a4a7277eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999ce77e-874c-49ab-a841-6597ecf0d5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999ce77e-874c-49ab-a841-6597ecf0d5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492047c3-8227-43e1-b172-3b47ac725396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492047c3-8227-43e1-b172-3b47ac725396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85df12a6-9a8f-4553-ba3d-853db79066ec', 'volume_name': 'volume-85df12a6-9a8f-4553-ba3d-853db79066ec', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5eb1fb-043d-4233-85dc-34b132245504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5eb1fb-043d-4233-85dc-34b132245504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5206fc-7e96-4a50-93cd-f9332056cd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Volume 85df12a6-9a8f-4553-ba3d-853db79066ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85df12a6-9a8f-4553-ba3d-853db79066ec', 'volume_size': 1} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-543129174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85df12a6-9a8f-4553-ba3d-853db79066ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a7c54531e4330ab97e09a7fa8010d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:36Z,use_quota=True,user_id='12685fde24014db8855af6a4a7277eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Creating volume 85df12a6-9a8f-4553-ba3d-853db79066ec {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:36 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:36 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec 1073741824 Nov 03 20:27:36 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Flow 'volume_create_manager' (d1b2d70b-ee5b-4bbf-9b85-961f75a8381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dd949d-393f-41c7-a83e-977796e98799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dd949d-393f-41c7-a83e-977796e98799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-239868817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4850dde0-d860-490e-a29b-1825281d614a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fa1a362054442184ff8af744b9e7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:36Z,use_quota=True,user_id='7be17065105c428a844772c1a9154706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c86f203-edac-46dd-83ef-2284d2f95047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c86f203-edac-46dd-83ef-2284d2f95047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66d604a-d608-489a-b40e-95d102190e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66d604a-d608-489a-b40e-95d102190e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4850dde0-d860-490e-a29b-1825281d614a', 'volume_name': 'volume-4850dde0-d860-490e-a29b-1825281d614a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8350b6d1-ea56-4381-b79e-f9a5dad2942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8350b6d1-ea56-4381-b79e-f9a5dad2942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4ebcc4-1d18-48b2-a507-7413d6a0888c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Volume 4850dde0-d860-490e-a29b-1825281d614a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4850dde0-d860-490e-a29b-1825281d614a', 'volume_size': 1} Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:36 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec 1073741824" returned: 0 in 0.440s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:37 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec Nov 03 20:27:37 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:37 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec" returned: 0 in 0.256s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-239868817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4850dde0-d860-490e-a29b-1825281d614a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fa1a362054442184ff8af744b9e7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:36Z,use_quota=True,user_id='7be17065105c428a844772c1a9154706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Creating volume 4850dde0-d860-490e-a29b-1825281d614a {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:37 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5206fc-7e96-4a50-93cd-f9332056cd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85df12a6-9a8f-4553-ba3d-853db79066ec', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:37 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a 1073741824 Nov 03 20:27:37 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b6c578-34f5-4259-ac67-b0afeffe07e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:37 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Volume volume-85df12a6-9a8f-4553-ba3d-853db79066ec (85df12a6-9a8f-4553-ba3d-853db79066ec): created successfully Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b6c578-34f5-4259-ac67-b0afeffe07e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Flow 'volume_create_manager' (21238bfc-b299-4894-86bf-2890c988da67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d6937edb-fae5-4215-8d2b-409fd6f1be24 tempest-VolumesListTestJSON-58674333 None] Created volume successfully. Nov 03 20:27:37 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a 1073741824" returned: 0 in 0.439s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:37 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a Nov 03 20:27:37 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:37 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a" returned: 0 in 0.238s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4ebcc4-1d18-48b2-a507-7413d6a0888c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4850dde0-d860-490e-a29b-1825281d614a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdc41cc-b0e3-412d-a6f8-a2ce13b42c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:38 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Volume volume-4850dde0-d860-490e-a29b-1825281d614a (4850dde0-d860-490e-a29b-1825281d614a): created successfully Nov 03 20:27:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdc41cc-b0e3-412d-a6f8-a2ce13b42c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Flow 'volume_create_manager' (d1b2d70b-ee5b-4bbf-9b85-961f75a8381f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:38 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-efd2dc60-b7a5-4a5b-b198-a5cda71b0444 tempest-VolumeDependencyTests-447580944 None] Created volume successfully. Nov 03 20:27:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] Creating offline snapshot b10a3f26-5059-44e9-9b93-48624a345f83 of volume 4850dde0-d860-490e-a29b-1825281d614a {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:27:38 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4da59af-d674-4d92-a2ce-3b77317e40d5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:38 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a Nov 03 20:27:38 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:39 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a" returned: 0 in 0.372s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:39 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 1G Nov 03 20:27:39 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:39 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 1G" returned: 0 in 0.421s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4850dde0-d860-490e-a29b-1825281d614a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:39 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4850dde0-d860-490e-a29b-1825281d614a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 Nov 03 20:27:39 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:39 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4850dde0-d860-490e-a29b-1825281d614a -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83" returned: 0 in 0.305s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:39 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 is being set with open permissions: ugo+rw Nov 03 20:27:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:39 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 Nov 03 20:27:39 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:40 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83" returned: 0 in 0.243s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:40 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.info Nov 03 20:27:40 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:40 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.info" returned: 0 in 0.256s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:40 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.info is being set with open permissions: ugo+rw Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:40 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.info Nov 03 20:27:40 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:40 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.info" returned: 0 in 0.260s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-23ceb224-214e-4505-9e1b-15da955bf138 tempest-VolumeDependencyTests-447580944 None] Create snapshot completed successfully Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "cinder-85df12a6-9a8f-4553-ba3d-853db79066ec-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Lock "cinder-85df12a6-9a8f-4553-ba3d-853db79066ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "cinder-quobyte-85df12a6-9a8f-4553-ba3d-853db79066ec" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Lock "cinder-quobyte-85df12a6-9a8f-4553-ba3d-853db79066ec" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc570ca-7f2c-481e-b0f3-dfe42ea7199b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:41 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec Nov 03 20:27:41 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:41 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Flow 'volume_create_manager' (cd220585-8635-4da5-92b1-fd26b3a73bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f45c268-bb32-4bac-90b7-ad011fd46ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec" returned: 0 in 0.405s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f45c268-bb32-4bac-90b7-ad011fd46ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1613722629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b4d20f-5858-4a77-a8fa-e33ab7b433a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fa1a362054442184ff8af744b9e7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b10a3f26-5059-44e9-9b93-48624a345f83,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:41Z,use_quota=True,user_id='7be17065105c428a844772c1a9154706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:41 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec Nov 03 20:27:41 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893b436f-7a1b-4bc8-b6dc-b7d86e82dde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893b436f-7a1b-4bc8-b6dc-b7d86e82dde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d738e65b-19e7-452e-8018-39d9e67d114d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d738e65b-19e7-452e-8018-39d9e67d114d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39b4d20f-5858-4a77-a8fa-e33ab7b433a4', 'volume_name': 'volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4', 'volume_size': 1, 'snapshot_id': 'b10a3f26-5059-44e9-9b93-48624a345f83'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba7e4d0-85a5-41a0-bad6-794e4c19003a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba7e4d0-85a5-41a0-bad6-794e4c19003a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44104bc7-ac7d-4b2d-a09f-bd8db2037151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:41 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Volume 39b4d20f-5858-4a77-a8fa-e33ab7b433a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4', 'volume_size': 1, 'snapshot_id': 'b10a3f26-5059-44e9-9b93-48624a345f83'} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Acquiring lock "cinder-quobyte-b10a3f26-5059-44e9-9b93-48624a345f83-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" by "_create_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-b10a3f26-5059-44e9-9b93-48624a345f83-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Creating volume 39b4d20f-5858-4a77-a8fa-e33ab7b433a4 from snapshot b10a3f26-5059-44e9-9b93-48624a345f83 {{(pid=87342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Acquiring lock "cinder-quobyte-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] snapshot: b10a3f26-5059-44e9-9b93-48624a345f83, volume: 39b4d20f-5858-4a77-a8fa-e33ab7b433a4, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46fa915-ec28-44ec-81bc-7f1972d21d1c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:41 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-85df12a6-9a8f-4553-ba3d-853db79066ec" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Lock "cinder-quobyte-85df12a6-9a8f-4553-ba3d-853db79066ec" released by "delete_volume" :: held 0.721s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:41 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 Nov 03 20:27:41 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Created reservations ['1c0f3135-025d-4205-a9c8-3a2fa0d305f5', 'edb432cf-d2ac-445d-a228-9db477dbf5b0', '8d823779-d984-4d79-b7a3-d462f00703b9', '4f1ccb26-9b23-42fa-b7c9-4cf39568c11c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:41 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:41 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:41 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83" returned: 0 in 0.386s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4850dde0-d860-490e-a29b-1825281d614a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e256901-ea19-4798-b5f6-1eb0851eb46d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:42 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.262s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Deleted volume successfully. Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f4852a80-c3d7-471b-bf74-6ced321c3759 tempest-VolumesListTestJSON-58674333 None] Lock "cinder-85df12a6-9a8f-4553-ba3d-853db79066ec-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:42 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a Nov 03 20:27:42 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Acquiring lock "cinder-ff019fea-475d-4183-85d4-0aed9cb46d4b-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Lock "cinder-ff019fea-475d-4183-85d4-0aed9cb46d4b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Acquiring lock "cinder-quobyte-ff019fea-475d-4183-85d4-0aed9cb46d4b" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Lock "cinder-quobyte-ff019fea-475d-4183-85d4-0aed9cb46d4b" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[023fd374-7477-46e4-9cf8-27c90ace0a6e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:42 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b Nov 03 20:27:42 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:42 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a" returned: 0 in 0.420s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:42 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 Nov 03 20:27:42 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:42 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b" returned: 0 in 0.368s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:42 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b Nov 03 20:27:42 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:42 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ff019fea-475d-4183-85d4-0aed9cb46d4b" returned: 0 in 0.259s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Lock "cinder-quobyte-ff019fea-475d-4183-85d4-0aed9cb46d4b" released by "delete_volume" :: held 0.677s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:42 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Created reservations ['376be36b-2f22-4c57-9555-9b3d4c297d91', 'f5acc5c9-d062-4aa2-8cf7-d21005ff8c97', '62183fa7-6fb2-4b21-b9a8-3f65380fa43f', 'c86eb12f-ae5e-4716-b65d-4f2d5839b9e9'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:43 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:43 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "cinder-bcd37217-8f12-432a-b009-082bae625ff0-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Lock "cinder-bcd37217-8f12-432a-b009-082bae625ff0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:43 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "cinder-quobyte-bcd37217-8f12-432a-b009-082bae625ff0" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.561s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:43 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Deleted volume successfully. Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Lock "cinder-quobyte-bcd37217-8f12-432a-b009-082bae625ff0" acquired by "delete_volume" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81b50f8d-3d66-48e4-8773-b23e87165e2a tempest-VolumesListTestJSON-58674333 None] Lock "cinder-ff019fea-475d-4183-85d4-0aed9cb46d4b-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9f96e1-6896-474e-8f12-9246dd384f63]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:43 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0 Nov 03 20:27:43 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:44 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0" returned: 0 in 0.516s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:44 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0 Nov 03 20:27:44 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:44 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bcd37217-8f12-432a-b009-082bae625ff0" returned: 0 in 0.490s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Lock "cinder-quobyte-bcd37217-8f12-432a-b009-082bae625ff0" released by "delete_volume" :: held 1.099s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:44 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Created reservations ['a479e485-860e-4dcb-8e24-f8c5d9caa9d6', '700f1c0c-c5fa-4e00-b886-a41ac047c71e', '91c212c3-f1c6-4609-92af-169a7a55a359', '9af2b575-d5dd-4d6e-9097-44e9b3eb5444'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:45 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:45 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:45 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.339s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:45 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Deleted volume successfully. Nov 03 20:27:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cc952e6-4f42-4f8d-b14e-bb5e97d3a5f9 tempest-VolumesListTestJSON-58674333 None] Lock "cinder-bcd37217-8f12-432a-b009-082bae625ff0-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:50 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" returned: 0 in 7.690s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a, size 1024.00 MB, duration 7.69 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:27:50 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Converted 1024.00 MB image at 133.14 MB/s Nov 03 20:27:50 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 is being set with open permissions: ugo+rw Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:50 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 Nov 03 20:27:50 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:50 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" returned: 0 in 0.317s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" released by "_copy_volume_from_snapshot" :: held 8.911s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-b10a3f26-5059-44e9-9b93-48624a345f83-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" released by "_create_volume_from_snapshot" :: held 8.978s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.994s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44104bc7-ac7d-4b2d-a09f-bd8db2037151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4', 'volume_size': 1, 'snapshot_id': 'b10a3f26-5059-44e9-9b93-48624a345f83'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa57bdec-29f5-447e-9eea-64dd13c262fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:50 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Volume volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 (39b4d20f-5858-4a77-a8fa-e33ab7b433a4): created successfully Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa57bdec-29f5-447e-9eea-64dd13c262fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Flow 'volume_create_manager' (cd220585-8635-4da5-92b1-fd26b3a73bff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Flow 'volume_create_manager' (3917d191-1708-49a0-aad3-061919b775b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14ddb8b-147f-48c1-b8cc-57117b1a79ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14ddb8b-147f-48c1-b8cc-57117b1a79ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1711339688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5de58b0-3693-4f01-a106-6cc2fdc89641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d23eb037f744c6e8126b9f702720dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:50Z,use_quota=True,user_id='78035b2f6dd144fe8a1c6cdaa8de5dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede500ac-391a-48d5-bd43-a15fe936f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede500ac-391a-48d5-bd43-a15fe936f598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bc5e77-a419-4f33-a943-b09bcee4a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bc5e77-a419-4f33-a943-b09bcee4a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5de58b0-3693-4f01-a106-6cc2fdc89641', 'volume_name': 'volume-f5de58b0-3693-4f01-a106-6cc2fdc89641', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d0573d-485c-4b32-a9ea-549fdc635873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d0573d-485c-4b32-a9ea-549fdc635873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3eb979-040b-4532-bf49-1f9e34ca3695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:50 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Volume f5de58b0-3693-4f01-a106-6cc2fdc89641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5de58b0-3693-4f01-a106-6cc2fdc89641', 'volume_size': 1} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1711339688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5de58b0-3693-4f01-a106-6cc2fdc89641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d23eb037f744c6e8126b9f702720dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:50Z,use_quota=True,user_id='78035b2f6dd144fe8a1c6cdaa8de5dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Creating volume f5de58b0-3693-4f01-a106-6cc2fdc89641 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:50 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:50 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-76a34df3-4553-4d98-a897-61f77c69ab5a tempest-VolumeDependencyTests-447580944 None] Created volume successfully. Nov 03 20:27:50 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641 1073741824 Nov 03 20:27:50 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:51 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641 1073741824" returned: 0 in 0.430s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:51 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641 Nov 03 20:27:51 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Acquiring lock "cinder-b10a3f26-5059-44e9-9b93-48624a345f83-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Lock "cinder-b10a3f26-5059-44e9-9b93-48624a345f83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Acquiring lock "cinder-quobyte-4850dde0-d860-490e-a29b-1825281d614a" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-4850dde0-d860-490e-a29b-1825281d614a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Acquiring lock "cinder-quobyte-b10a3f26-5059-44e9-9b93-48624a345f83" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-b10a3f26-5059-44e9-9b93-48624a345f83" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Deleting offline snapshot b10a3f26-5059-44e9-9b93-48624a345f83 of volume 4850dde0-d860-490e-a29b-1825281d614a {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] snapshot_file for this snap is: volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[734d1f8f-4afd-4f45-81df-79cd34788dbc]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:51 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641" returned: 0 in 0.296s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3eb979-040b-4532-bf49-1f9e34ca3695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5de58b0-3693-4f01-a106-6cc2fdc89641', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71930247-c624-448a-9977-cd8ed105eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:51 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Volume volume-f5de58b0-3693-4f01-a106-6cc2fdc89641 (f5de58b0-3693-4f01-a106-6cc2fdc89641): created successfully Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71930247-c624-448a-9977-cd8ed105eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Flow 'volume_create_manager' (3917d191-1708-49a0-aad3-061919b775b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:51 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 Nov 03 20:27:51 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-fce6c353-520b-4890-a9f9-624d407a6c7f tempest-AttachVolumeNegativeTest-538561877 None] Created volume successfully. Nov 03 20:27:51 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83" returned: 0 in 0.411s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4850dde0-d860-490e-a29b-1825281d614a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba2e291-ed7c-409b-b0ad-871f418ebe80]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Flow 'volume_create_manager' (7823a6b2-cc07-42c9-b405-4cf58b67aa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:51 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a Nov 03 20:27:51 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819a0a1e-a2fb-4542-948c-15c17dbb8137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819a0a1e-a2fb-4542-948c-15c17dbb8137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1790926952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0a601f-643c-4682-b6a0-1d886a0f36a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac743f60b76476582c3115d583613fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:52Z,use_quota=True,user_id='c062ab238a4844dfa9eebfb5a253602e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb163ec9-2dad-4b75-af36-712c3012ee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb163ec9-2dad-4b75-af36-712c3012ee88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9493d8ef-5453-442f-b1ae-5951fb40c021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9493d8ef-5453-442f-b1ae-5951fb40c021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0a601f-643c-4682-b6a0-1d886a0f36a6', 'volume_name': 'volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611865e1-37ff-46a3-bc74-02234ee4b370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611865e1-37ff-46a3-bc74-02234ee4b370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f080299a-8ea7-4693-ba8c-f6dd9bb3b86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:51 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Volume 6c0a601f-643c-4682-b6a0-1d886a0f36a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6', 'volume_size': 1} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1790926952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0a601f-643c-4682-b6a0-1d886a0f36a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac743f60b76476582c3115d583613fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:52Z,use_quota=True,user_id='c062ab238a4844dfa9eebfb5a253602e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Creating volume 6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:51 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:27:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:51 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 1073741824 Nov 03 20:27:51 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:52 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a" returned: 0 in 0.527s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:52 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 Nov 03 20:27:52 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:52 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 1073741824" returned: 0 in 0.442s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:52 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 Nov 03 20:27:52 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:52 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83" returned: 0 in 0.388s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:52 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6" returned: 0 in 0.280s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:52 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83 Nov 03 20:27:52 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f080299a-8ea7-4693-ba8c-f6dd9bb3b86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b13aca-fee0-4997-8574-3649cf503576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:52 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Volume volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 (6c0a601f-643c-4682-b6a0-1d886a0f36a6): created successfully Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b13aca-fee0-4997-8574-3649cf503576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Flow 'volume_create_manager' (7823a6b2-cc07-42c9-b405-4cf58b67aa48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:52 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-feb24361-69cd-4430-8d10-95b90257c869 tempest-VolumesSnapshotListTestJSON-845578952 None] Created volume successfully. Nov 03 20:27:52 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a.b10a3f26-5059-44e9-9b93-48624a345f83" returned: 0 in 0.298s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-b10a3f26-5059-44e9-9b93-48624a345f83" released by "_delete_snapshot" :: held 1.744s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-4850dde0-d860-490e-a29b-1825281d614a" released by "delete_snapshot" :: held 1.769s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Created reservations ['9f4ef168-faeb-451b-8215-b26bfbec4e4c', '07c68f4f-dbfe-44f3-800d-818927e82740', '0c04cc5c-a211-477f-9b76-2ae7a2307103', '8748fa7b-eca8-4971-b086-a4ffea11104f'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:53 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Delete snapshot completed successfully. Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-12a8c4d2-7e2c-431a-bb7d-08b835a6c23e tempest-VolumeDependencyTests-447580944 None] Lock "cinder-b10a3f26-5059-44e9-9b93-48624a345f83-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Acquiring lock "cinder-4850dde0-d860-490e-a29b-1825281d614a-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Lock "cinder-4850dde0-d860-490e-a29b-1825281d614a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Acquiring lock "cinder-quobyte-4850dde0-d860-490e-a29b-1825281d614a" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-4850dde0-d860-490e-a29b-1825281d614a" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e55462a-7a33-4ba6-bea6-4f1798c97ffc]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-00beb344-78b8-43e7-8803-766e15880b3f req-942043c1-1627-4f5f-83fb-1ec6dde2c345 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-00beb344-78b8-43e7-8803-766e15880b3f req-942043c1-1627-4f5f-83fb-1ec6dde2c345 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-00beb344-78b8-43e7-8803-766e15880b3f req-942043c1-1627-4f5f-83fb-1ec6dde2c345 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-00beb344-78b8-43e7-8803-766e15880b3f req-942043c1-1627-4f5f-83fb-1ec6dde2c345 tempest-AttachVolumeNegativeTest-538561877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-f5de58b0-3693-4f01-a106-6cc2fdc89641', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8928ab7-d859-46ce-8b5f-68330c67da45', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:27:53 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a Nov 03 20:27:53 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:53 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-00beb344-78b8-43e7-8803-766e15880b3f req-942043c1-1627-4f5f-83fb-1ec6dde2c345 tempest-AttachVolumeNegativeTest-538561877 None] attachment_update completed successfully. Nov 03 20:27:53 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a" returned: 0 in 0.432s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:53 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a Nov 03 20:27:53 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=199,cinder:SELECT=166,cinder:INSERT=61,cinder:DELETE=15 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=205,cinder:SELECT=145,cinder:DELETE=21,cinder:INSERT=54 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] Creating offline snapshot b231094e-db70-4bf5-828d-f1e6846f198c of volume 6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[103b93bc-17d9-4cc8-8f58-19a560322058]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:54 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4850dde0-d860-490e-a29b-1825281d614a" returned: 0 in 0.345s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-4850dde0-d860-490e-a29b-1825281d614a" released by "delete_volume" :: held 0.869s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:54 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 Nov 03 20:27:54 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Created reservations ['eaad404b-219f-4879-89ed-0b8dc9e414a3', '1cccacfd-5442-4ecb-9083-c1506006f770', '0a78b16d-0837-4bd0-a651-370e48f28f74', 'ff89c180-5a50-4feb-9aed-4d74cbd9c7a4'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:54 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:54 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Acquiring lock "cinder-39b4d20f-5858-4a77-a8fa-e33ab7b433a4-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Lock "cinder-39b4d20f-5858-4a77-a8fa-e33ab7b433a4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Acquiring lock "cinder-quobyte-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:54 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6" returned: 0 in 0.485s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" acquired by "delete_volume" :: waited 0.031s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:54 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c 1G Nov 03 20:27:54 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c4edaa-e4f9-4077-a248-20d44ccc1371]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:54 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.322s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:54 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Deleted volume successfully. Nov 03 20:27:54 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 Nov 03 20:27:54 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-54691f6c-e194-434a-b402-8e6bae7f522e tempest-VolumeDependencyTests-447580944 None] Lock "cinder-4850dde0-d860-490e-a29b-1825281d614a-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:55 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" returned: 0 in 0.367s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:55 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c 1G" returned: 0 in 0.435s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:55 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4 Nov 03 20:27:55 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:55 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c Nov 03 20:27:55 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:55 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" returned: 0 in 0.267s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Lock "cinder-quobyte-39b4d20f-5858-4a77-a8fa-e33ab7b433a4" released by "delete_volume" :: held 0.678s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Created reservations ['c060ab2d-5467-4cd8-86d3-0c10696712dc', 'db5aacc6-b93a-48a9-bdcb-0c418b7e3a5a', '5903aa71-c746-4f82-817b-6a5b065508b1', '20c74bd9-4ca2-42aa-98fb-713b08f0a037'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:55 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c" returned: 0 in 0.317s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:55 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c is being set with open permissions: ugo+rw Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:55 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c Nov 03 20:27:55 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:55 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:27:55 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:55 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c" returned: 0 in 0.337s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:55 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.299s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:55 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Deleted volume successfully. Nov 03 20:27:55 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.info Nov 03 20:27:55 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e7d04e-1325-41ab-be51-a0283247a27d tempest-VolumeDependencyTests-447580944 None] Lock "cinder-39b4d20f-5858-4a77-a8fa-e33ab7b433a4-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:56 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.info" returned: 0 in 0.299s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:56 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.info is being set with open permissions: ugo+rw Nov 03 20:27:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:56 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.info Nov 03 20:27:56 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:56 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.info" returned: 0 in 0.274s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.298s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:56 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b67fb64a-9aa6-44f2-87d3-01a0f8439542 tempest-VolumesSnapshotListTestJSON-845578952 None] Create snapshot completed successfully Nov 03 20:27:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] Creating offline snapshot d0cb229f-1465-4bba-b3ed-d1431f8d0316 of volume 6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:27:57 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b4021f-5ae2-46f0-88d2-565b8dfa36b8]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:57 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c Nov 03 20:27:57 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:58 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c" returned: 0 in 0.419s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:27:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:58 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 1G Nov 03 20:27:58 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:58 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 1G" returned: 0 in 0.481s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:58 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 Nov 03 20:27:58 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:58 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316" returned: 0 in 0.338s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:58 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 is being set with open permissions: ugo+rw Nov 03 20:27:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:58 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 Nov 03 20:27:58 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:59 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316" returned: 0 in 0.252s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.627s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:59 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8c92f6d3-e0f7-45a2-862d-0672857ed11f tempest-VolumesSnapshotListTestJSON-845578952 None] Create snapshot completed successfully Nov 03 20:27:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] Creating offline snapshot 9de8f944-b325-4dcc-9cd7-95f617cd65cd of volume 6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:27:59 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fa0fad-1805-4765-8787-53a2d9e0bc7b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:00 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 Nov 03 20:28:00 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:00 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316" returned: 0 in 0.426s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:28:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:00 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd 1G Nov 03 20:28:00 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:00 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd 1G" returned: 0 in 0.557s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:00 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd Nov 03 20:28:00 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:01 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd" returned: 0 in 0.321s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:01 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd is being set with open permissions: ugo+rw Nov 03 20:28:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:01 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd Nov 03 20:28:01 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:01 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd" returned: 0 in 0.264s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.719s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:01 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a394924b-7a49-41e0-9dcc-800d6e3ea93e tempest-VolumesSnapshotListTestJSON-845578952 None] Create snapshot completed successfully Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "cinder-9de8f944-b325-4dcc-9cd7-95f617cd65cd-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-9de8f944-b325-4dcc-9cd7-95f617cd65cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "cinder-quobyte-9de8f944-b325-4dcc-9cd7-95f617cd65cd" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-9de8f944-b325-4dcc-9cd7-95f617cd65cd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Deleting offline snapshot 9de8f944-b325-4dcc-9cd7-95f617cd65cd of volume 6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] snapshot_file for this snap is: volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b455b5-67ce-433b-b433-b8a5b6da44d2]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:03 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd Nov 03 20:28:03 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:03 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd" returned: 0 in 0.431s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d883f3f1-8a55-404f-974b-90a40ceffc3f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:04 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 Nov 03 20:28:04 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:04 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316" returned: 0 in 0.426s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:28:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:04 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd Nov 03 20:28:04 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:04 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd" returned: 0 in 0.421s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:04 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd Nov 03 20:28:04 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:05 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.9de8f944-b325-4dcc-9cd7-95f617cd65cd" returned: 0 in 0.287s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-9de8f944-b325-4dcc-9cd7-95f617cd65cd" released by "_delete_snapshot" :: held 1.758s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" released by "delete_snapshot" :: held 1.783s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Created reservations ['f44550da-351a-4a84-9b44-dc79b64f4a1f', 'c616778c-36bf-4670-8c04-39dfa9d3706d', '922a1d8a-6258-4bc0-8afa-24121cf2763e', '930f39ce-2e43-4ac7-95f5-357c7a7f9a42'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:05 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Delete snapshot completed successfully. Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f5dfc9fc-31fb-4b84-8c32-c91e23bcbd48 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-9de8f944-b325-4dcc-9cd7-95f617cd65cd-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "cinder-d0cb229f-1465-4bba-b3ed-d1431f8d0316-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-d0cb229f-1465-4bba-b3ed-d1431f8d0316-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "cinder-quobyte-d0cb229f-1465-4bba-b3ed-d1431f8d0316" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-d0cb229f-1465-4bba-b3ed-d1431f8d0316" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Deleting offline snapshot d0cb229f-1465-4bba-b3ed-d1431f8d0316 of volume 6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] snapshot_file for this snap is: volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6a2d76-1364-44e9-8172-f6a465b309be]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:05 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 Nov 03 20:28:05 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:06 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316" returned: 0 in 0.417s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:28:06 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd89c61-35c0-4c9c-8475-aade7fcca664]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:06 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c Nov 03 20:28:06 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:06 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c" returned: 0 in 0.461s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:28:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:06 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 Nov 03 20:28:06 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:06 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316" returned: 0 in 0.374s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:07 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316 Nov 03 20:28:07 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:07 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.d0cb229f-1465-4bba-b3ed-d1431f8d0316" returned: 0 in 0.281s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-d0cb229f-1465-4bba-b3ed-d1431f8d0316" released by "_delete_snapshot" :: held 1.690s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" released by "delete_snapshot" :: held 1.729s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Created reservations ['1a065695-9aa8-45ef-8370-9b10fccc9240', 'be0b7859-4148-4089-afb3-cf0829bb5340', 'fee3bd9e-f451-42c5-bde0-7b0ca9bb2229', 'd8c1a0ba-ddf9-4617-a906-2d93a517177a'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:07 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Delete snapshot completed successfully. Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-8cb8d7e7-ae96-4068-b171-15cdac393cd9 tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-d0cb229f-1465-4bba-b3ed-d1431f8d0316-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "cinder-b231094e-db70-4bf5-828d-f1e6846f198c-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-b231094e-db70-4bf5-828d-f1e6846f198c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "cinder-quobyte-b231094e-db70-4bf5-828d-f1e6846f198c" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-b231094e-db70-4bf5-828d-f1e6846f198c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Deleting offline snapshot b231094e-db70-4bf5-828d-f1e6846f198c of volume 6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] snapshot_file for this snap is: volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[be491cc0-8421-4fc2-8ba2-14ca6e4839e0]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:07 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c Nov 03 20:28:07 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:08 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c" returned: 0 in 0.371s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:28:08 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[888b629b-26b3-45fc-b350-1987fa2ab180]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:08 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 Nov 03 20:28:08 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:08 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6" returned: 0 in 0.359s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:08 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c Nov 03 20:28:08 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:08 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c" returned: 0 in 0.344s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:08 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c Nov 03 20:28:08 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:09 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6.b231094e-db70-4bf5-828d-f1e6846f198c" returned: 0 in 0.246s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-b231094e-db70-4bf5-828d-f1e6846f198c" released by "_delete_snapshot" :: held 1.430s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" released by "delete_snapshot" :: held 1.455s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:09 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Created reservations ['6eb4e20e-5b2d-4f4a-ad6f-0615128326a4', '13066f68-01af-4d9a-bda1-9647c959b0b9', '37296451-4b43-4701-8936-2f4431c29b40', 'f07cf948-a829-49f8-9f4c-8d8837548975'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:09 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Delete snapshot completed successfully. Nov 03 20:28:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-6e23fb57-f1d5-4af1-ae89-7560e73bffdb tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-b231094e-db70-4bf5-828d-f1e6846f198c-delete_snapshot" released by "delete_snapshot" :: held 1.595s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "cinder-6c0a601f-643c-4682-b6a0-1d886a0f36a6-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-6c0a601f-643c-4682-b6a0-1d886a0f36a6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b84239-95bf-4184-8f8b-b22c51baa3c5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:10 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 Nov 03 20:28:10 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:10 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6" returned: 0 in 0.374s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:10 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6 Nov 03 20:28:10 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:10 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6c0a601f-643c-4682-b6a0-1d886a0f36a6" returned: 0 in 0.242s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-quobyte-6c0a601f-643c-4682-b6a0-1d886a0f36a6" released by "delete_volume" :: held 0.679s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Created reservations ['7303baea-8282-4b4f-8c67-208334a3b66f', 'c6baaa4b-cd79-4a60-8835-03a3322bb13d', '8f6da391-8bfa-4b52-b64a-4c52e212a95e', '6478cb20-3fd0-464e-802a-ce49a747a9d5'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:10 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:28:10 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:11 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.264s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:11 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:11 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Deleted volume successfully. Nov 03 20:28:11 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-de44c15f-6830-46b5-818e-61c6c39c09ff tempest-VolumesSnapshotListTestJSON-845578952 None] Lock "cinder-6c0a601f-643c-4682-b6a0-1d886a0f36a6-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:20 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=35,cinder:INSERT=10,cinder:UPDATE=43,cinder:DELETE=4 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:28:21 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=38,cinder:INSERT=15,cinder:UPDATE=43,cinder:DELETE=2 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:23 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:28:23 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:23 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.275s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:28:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:28:32 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-201da08e-3735-4078-819e-60888a36330c req-4b676e15-e22d-4ed7-8055-f1b8ba9c5e65 tempest-AttachVolumeNegativeTest-538561877 None] Terminate volume connection completed successfully. Nov 03 20:28:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-201da08e-3735-4078-819e-60888a36330c req-4b676e15-e22d-4ed7-8055-f1b8ba9c5e65 tempest-AttachVolumeNegativeTest-538561877 None] Deleting attachment d8928ab7-d859-46ce-8b5f-68330c67da45. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Flow 'volume_create_manager' (d8f5ac30-a9c3-4739-aace-4efdd7294c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330c7dee-d7eb-4b0c-9666-fab9047eb480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330c7dee-d7eb-4b0c-9666-fab9047eb480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2023281112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87232553-5382-412e-aad6-781456b43032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc88e69e608448e0afaf82de96895308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:34Z,use_quota=True,user_id='4929ce44145f455cbdc86860240fc407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6ffa2a-d5a1-466a-8967-735c50dcd6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6ffa2a-d5a1-466a-8967-735c50dcd6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77877823-8217-4bfe-a73c-586df9e32d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77877823-8217-4bfe-a73c-586df9e32d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87232553-5382-412e-aad6-781456b43032', 'volume_name': 'volume-87232553-5382-412e-aad6-781456b43032', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f48e82-5be7-4114-b714-469019c2ac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f48e82-5be7-4114-b714-469019c2ac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bffe49f-0e97-429a-bf49-e25d2b30c524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:34 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Volume 87232553-5382-412e-aad6-781456b43032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87232553-5382-412e-aad6-781456b43032', 'volume_size': 1} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2023281112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87232553-5382-412e-aad6-781456b43032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc88e69e608448e0afaf82de96895308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:34Z,use_quota=True,user_id='4929ce44145f455cbdc86860240fc407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Creating volume 87232553-5382-412e-aad6-781456b43032 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:28:34 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:34 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 1073741824 Nov 03 20:28:34 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:34 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 1073741824" returned: 0 in 0.651s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:34 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 Nov 03 20:28:34 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:35 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032" returned: 0 in 0.284s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:28:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bffe49f-0e97-429a-bf49-e25d2b30c524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87232553-5382-412e-aad6-781456b43032', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab13bc7-4d32-4e89-a4cb-c76a55aa873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:35 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Volume volume-87232553-5382-412e-aad6-781456b43032 (87232553-5382-412e-aad6-781456b43032): created successfully Nov 03 20:28:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab13bc7-4d32-4e89-a4cb-c76a55aa873a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Flow 'volume_create_manager' (d8f5ac30-a9c3-4739-aace-4efdd7294c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b6d96e99-0edb-4950-be8b-3fa543bbc7d1 tempest-TestStampPattern-1868899069 None] Created volume successfully. Nov 03 20:28:45 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:28:45 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:29:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-58da1e65-62fd-4bd4-a7eb-b2e57a8ff04e req-870e9948-e90b-4cdf-995e-cf5bd1e1850a tempest-TestStampPattern-1868899069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-58da1e65-62fd-4bd4-a7eb-b2e57a8ff04e req-870e9948-e90b-4cdf-995e-cf5bd1e1850a tempest-TestStampPattern-1868899069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-58da1e65-62fd-4bd4-a7eb-b2e57a8ff04e req-870e9948-e90b-4cdf-995e-cf5bd1e1850a tempest-TestStampPattern-1868899069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-58da1e65-62fd-4bd4-a7eb-b2e57a8ff04e req-870e9948-e90b-4cdf-995e-cf5bd1e1850a tempest-TestStampPattern-1868899069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-87232553-5382-412e-aad6-781456b43032', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3e9ccbe-f3b1-4e84-8339-2098b8f7d76d', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:29:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-58da1e65-62fd-4bd4-a7eb-b2e57a8ff04e req-870e9948-e90b-4cdf-995e-cf5bd1e1850a tempest-TestStampPattern-1868899069 None] attachment_update completed successfully. Nov 03 20:29:08 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-95d3a61b-8f25-481f-b74b-c8fea3f1d153 req-24dd0486-2592-4561-90e0-b13b447226ca tempest-TestStampPattern-1868899069 None] Terminate volume connection completed successfully. Nov 03 20:29:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-95d3a61b-8f25-481f-b74b-c8fea3f1d153 req-24dd0486-2592-4561-90e0-b13b447226ca tempest-TestStampPattern-1868899069 None] Deleting attachment c3e9ccbe-f3b1-4e84-8339-2098b8f7d76d. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:29:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] Creating offline snapshot 06c344d2-af5e-4cbf-807f-bc8c62f8df90 of volume 87232553-5382-412e-aad6-781456b43032 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:29:09 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[196a3fa6-d48d-4b13-bd6c-cd12a5346754]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:09 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 Nov 03 20:29:09 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:10 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032" returned: 0 in 0.412s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:10 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 1G Nov 03 20:29:10 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Flow 'volume_create_manager' (4e023ff8-2eaf-41d7-b6ea-6ae50e4bdc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f07889-335a-4ed2-b2af-9a0a5682c330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f07889-335a-4ed2-b2af-9a0a5682c330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1975715067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83233ec6-5be0-4de3-aa21-a2e1c7aac3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d23eb037f744c6e8126b9f702720dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:11Z,use_quota=True,user_id='78035b2f6dd144fe8a1c6cdaa8de5dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a3be15-e6c3-4bab-a9ab-7f02f199ea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a3be15-e6c3-4bab-a9ab-7f02f199ea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb30da3-3319-41c3-a7c2-4802c26d2fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb30da3-3319-41c3-a7c2-4802c26d2fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83233ec6-5be0-4de3-aa21-a2e1c7aac3c3', 'volume_name': 'volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbfe36f-5e8d-421e-b76c-745919ad627c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbfe36f-5e8d-421e-b76c-745919ad627c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea25d7f5-4a91-467a-8f20-aaed21eb94ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:10 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Volume 83233ec6-5be0-4de3-aa21-a2e1c7aac3c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3', 'volume_size': 1} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:10 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 1G" returned: 0 in 0.492s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87232553-5382-412e-aad6-781456b43032 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:10 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87232553-5382-412e-aad6-781456b43032 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 Nov 03 20:29:10 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:11 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87232553-5382-412e-aad6-781456b43032 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90" returned: 0 in 0.316s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:11 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 is being set with open permissions: ugo+rw Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:11 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 Nov 03 20:29:11 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:11 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90" returned: 0 in 0.254s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:11 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.info Nov 03 20:29:11 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:11 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.info" returned: 0 in 0.247s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:11 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.info is being set with open permissions: ugo+rw Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:11 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.info Nov 03 20:29:11 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:11 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.info" returned: 0 in 0.234s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.215s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1975715067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83233ec6-5be0-4de3-aa21-a2e1c7aac3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d23eb037f744c6e8126b9f702720dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:11Z,use_quota=True,user_id='78035b2f6dd144fe8a1c6cdaa8de5dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Creating volume 83233ec6-5be0-4de3-aa21-a2e1c7aac3c3 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:29:11 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:29:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:11 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3 1073741824 Nov 03 20:29:11 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:11 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7cc8ae93-116d-4b63-953f-ba8308a75a1f tempest-TestStampPattern-1868899069 None] Create snapshot completed successfully Nov 03 20:29:12 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3 1073741824" returned: 0 in 0.424s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:12 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3 Nov 03 20:29:12 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:12 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3" returned: 0 in 0.252s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:29:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea25d7f5-4a91-467a-8f20-aaed21eb94ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e82a2e1-6607-428f-a3a3-7581535e8bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:12 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Volume volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3 (83233ec6-5be0-4de3-aa21-a2e1c7aac3c3): created successfully Nov 03 20:29:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e82a2e1-6607-428f-a3a3-7581535e8bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Flow 'volume_create_manager' (4e023ff8-2eaf-41d7-b6ea-6ae50e4bdc51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:12 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-1fce8279-3d56-4489-aafd-44de2b8f51a8 tempest-AttachVolumeNegativeTest-538561877 None] Created volume successfully. Nov 03 20:29:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-2db50039-53bd-45a1-9115-fa5e36a2d361 req-226dba0c-77c7-478a-a3a3-3ecbbd4a9882 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-2db50039-53bd-45a1-9115-fa5e36a2d361 req-226dba0c-77c7-478a-a3a3-3ecbbd4a9882 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-2db50039-53bd-45a1-9115-fa5e36a2d361 req-226dba0c-77c7-478a-a3a3-3ecbbd4a9882 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-2db50039-53bd-45a1-9115-fa5e36a2d361 req-226dba0c-77c7-478a-a3a3-3ecbbd4a9882 tempest-AttachVolumeNegativeTest-538561877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f80359db-fd00-4fc8-8cd9-bfceaa068224', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:29:14 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-2db50039-53bd-45a1-9115-fa5e36a2d361 req-226dba0c-77c7-478a-a3a3-3ecbbd4a9882 tempest-AttachVolumeNegativeTest-538561877 None] attachment_update completed successfully. Nov 03 20:29:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-cee7e427-09bf-41c0-9943-776f44a1c7bc req-bb62446d-fc6b-4fdc-ab18-3160899d6136 tempest-AttachVolumeNegativeTest-538561877 None] Terminate volume connection completed successfully. Nov 03 20:29:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-cee7e427-09bf-41c0-9943-776f44a1c7bc req-bb62446d-fc6b-4fdc-ab18-3160899d6136 tempest-AttachVolumeNegativeTest-538561877 None] Deleting attachment f80359db-fd00-4fc8-8cd9-bfceaa068224. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Flow 'volume_create_manager' (fd98db27-f704-423b-9a77-6f1c90c57121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450e6e9c-d354-4e77-83bd-92a6ad20d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450e6e9c-d354-4e77-83bd-92a6ad20d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-616863380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c0573c-0c53-4b3c-ac72-f26248f37468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc88e69e608448e0afaf82de96895308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=06c344d2-af5e-4cbf-807f-bc8c62f8df90,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:20Z,use_quota=True,user_id='4929ce44145f455cbdc86860240fc407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5baf188e-d1d8-4572-8b51-2291669d0b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5baf188e-d1d8-4572-8b51-2291669d0b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a6245a-4ee9-4309-9974-d2d862fb828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a6245a-4ee9-4309-9974-d2d862fb828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75c0573c-0c53-4b3c-ac72-f26248f37468', 'volume_name': 'volume-75c0573c-0c53-4b3c-ac72-f26248f37468', 'volume_size': 1, 'snapshot_id': '06c344d2-af5e-4cbf-807f-bc8c62f8df90'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dcf5f0-4f72-41c8-9ee3-e8ff62f5a02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dcf5f0-4f72-41c8-9ee3-e8ff62f5a02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c23df7f-28a1-4911-befd-0f2fa70eaa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:19 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Volume 75c0573c-0c53-4b3c-ac72-f26248f37468: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75c0573c-0c53-4b3c-ac72-f26248f37468', 'volume_size': 1, 'snapshot_id': '06c344d2-af5e-4cbf-807f-bc8c62f8df90'} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Acquiring lock "cinder-quobyte-06c344d2-af5e-4cbf-807f-bc8c62f8df90-75c0573c-0c53-4b3c-ac72-f26248f37468" by "_create_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-06c344d2-af5e-4cbf-807f-bc8c62f8df90-75c0573c-0c53-4b3c-ac72-f26248f37468" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Creating volume 75c0573c-0c53-4b3c-ac72-f26248f37468 from snapshot 06c344d2-af5e-4cbf-807f-bc8c62f8df90 {{(pid=87342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Acquiring lock "cinder-quobyte-75c0573c-0c53-4b3c-ac72-f26248f37468" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-75c0573c-0c53-4b3c-ac72-f26248f37468" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] snapshot: 06c344d2-af5e-4cbf-807f-bc8c62f8df90, volume: 75c0573c-0c53-4b3c-ac72-f26248f37468, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[049ba8e0-53bb-41ce-b069-e386c9da2ac6]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:20 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 Nov 03 20:29:20 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:20 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90" returned: 0 in 0.452s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87232553-5382-412e-aad6-781456b43032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1f409b-4799-445e-a8b5-108bc4ff4fb1]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:20 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 Nov 03 20:29:20 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:20 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032" returned: 0 in 0.417s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468 not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:29:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:21 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468 Nov 03 20:29:21 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:29:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:23 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:29:23 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:24 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.911s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:29:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:29:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:29:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:29:29 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=24,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:29:30 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=21,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:29:30 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468" returned: 0 in 9.584s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:30 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032, size 1024.00 MB, duration 9.59 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:29:30 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Converted 1024.00 MB image at 106.83 MB/s Nov 03 20:29:30 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468 is being set with open permissions: ugo+rw Nov 03 20:29:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:30 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468 Nov 03 20:29:30 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:30 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468" returned: 0 in 0.328s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-75c0573c-0c53-4b3c-ac72-f26248f37468" released by "_copy_volume_from_snapshot" :: held 10.929s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-06c344d2-af5e-4cbf-807f-bc8c62f8df90-75c0573c-0c53-4b3c-ac72-f26248f37468" released by "_create_volume_from_snapshot" :: held 11.012s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.033s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c23df7f-28a1-4911-befd-0f2fa70eaa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c0573c-0c53-4b3c-ac72-f26248f37468', 'volume_size': 1, 'snapshot_id': '06c344d2-af5e-4cbf-807f-bc8c62f8df90'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c680ce43-a71f-46ba-abd4-b28cd9202dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:31 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Volume volume-75c0573c-0c53-4b3c-ac72-f26248f37468 (75c0573c-0c53-4b3c-ac72-f26248f37468): created successfully Nov 03 20:29:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c680ce43-a71f-46ba-abd4-b28cd9202dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Flow 'volume_create_manager' (fd98db27-f704-423b-9a77-6f1c90c57121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:31 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7eae86d9-e165-42f1-b902-d360a7912ece tempest-TestStampPattern-1868899069 None] Created volume successfully. Nov 03 20:29:41 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:29:41 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=2,cinder:INSERT=1,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:29:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:29:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Flow 'volume_create_manager' (6e69c1ce-7dcd-4958-803e-c12392bb5ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c548d17-d5f4-4a7a-9cb4-b40bcf52f337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c548d17-d5f4-4a7a-9cb4-b40bcf52f337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1398603823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d328484-97f7-4afd-99ad-3506d6a46ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d23eb037f744c6e8126b9f702720dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:59Z,use_quota=True,user_id='78035b2f6dd144fe8a1c6cdaa8de5dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297980b7-6f48-4c14-b039-e055c02fd1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297980b7-6f48-4c14-b039-e055c02fd1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc63be8-4290-467d-8d88-0844c65fd861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc63be8-4290-467d-8d88-0844c65fd861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d328484-97f7-4afd-99ad-3506d6a46ba6', 'volume_name': 'volume-6d328484-97f7-4afd-99ad-3506d6a46ba6', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2e82f2-4607-4445-84c0-44d3165d4a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2e82f2-4607-4445-84c0-44d3165d4a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d185002-6d3e-4a88-872a-1043d1f928c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:59 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Volume 6d328484-97f7-4afd-99ad-3506d6a46ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d328484-97f7-4afd-99ad-3506d6a46ba6', 'volume_size': 1} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1398603823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d328484-97f7-4afd-99ad-3506d6a46ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d23eb037f744c6e8126b9f702720dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:59Z,use_quota=True,user_id='78035b2f6dd144fe8a1c6cdaa8de5dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Creating volume 6d328484-97f7-4afd-99ad-3506d6a46ba6 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:29:59 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:59 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6 1073741824 Nov 03 20:29:59 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:59 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6 1073741824" returned: 0 in 0.431s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:59 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6 Nov 03 20:29:59 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:59 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6" returned: 0 in 0.242s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d185002-6d3e-4a88-872a-1043d1f928c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d328484-97f7-4afd-99ad-3506d6a46ba6', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf27e8d-e1e1-455c-bd89-a906b52e90f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:59 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Volume volume-6d328484-97f7-4afd-99ad-3506d6a46ba6 (6d328484-97f7-4afd-99ad-3506d6a46ba6): created successfully Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf27e8d-e1e1-455c-bd89-a906b52e90f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Flow 'volume_create_manager' (6e69c1ce-7dcd-4958-803e-c12392bb5ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:00 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-3626eaac-ceaa-4007-91d0-e707e35a4540 tempest-AttachVolumeNegativeTest-538561877 None] Created volume successfully. Nov 03 20:30:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-7bbe856e-77cb-4c92-962c-e4addf5d28b8 req-7865f16d-7e43-4161-aa85-61c196f93c79 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-7bbe856e-77cb-4c92-962c-e4addf5d28b8 req-7865f16d-7e43-4161-aa85-61c196f93c79 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-7bbe856e-77cb-4c92-962c-e4addf5d28b8 req-7865f16d-7e43-4161-aa85-61c196f93c79 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-7bbe856e-77cb-4c92-962c-e4addf5d28b8 req-7865f16d-7e43-4161-aa85-61c196f93c79 tempest-AttachVolumeNegativeTest-538561877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-6d328484-97f7-4afd-99ad-3506d6a46ba6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b81317d9-db1c-463a-80dc-80a10dd3083c', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:30:00 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-7bbe856e-77cb-4c92-962c-e4addf5d28b8 req-7865f16d-7e43-4161-aa85-61c196f93c79 tempest-AttachVolumeNegativeTest-538561877 None] attachment_update completed successfully. Nov 03 20:30:02 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-42b40796-241d-4031-861a-c19154652c06 req-196e9c35-538d-44b4-90e2-7a82bc29ec74 tempest-AttachVolumeNegativeTest-538561877 None] Terminate volume connection completed successfully. Nov 03 20:30:02 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-42b40796-241d-4031-861a-c19154652c06 req-196e9c35-538d-44b4-90e2-7a82bc29ec74 tempest-AttachVolumeNegativeTest-538561877 None] Deleting attachment b81317d9-db1c-463a-80dc-80a10dd3083c. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:30:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "cinder-6d328484-97f7-4afd-99ad-3506d6a46ba6-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-6d328484-97f7-4afd-99ad-3506d6a46ba6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "cinder-quobyte-6d328484-97f7-4afd-99ad-3506d6a46ba6" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-quobyte-6d328484-97f7-4afd-99ad-3506d6a46ba6" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f48209b-0bb5-46cf-be41-ec01d0a7e2ee]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:07 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6 Nov 03 20:30:07 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:07 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6" returned: 0 in 0.352s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:07 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6 Nov 03 20:30:07 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:07 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6d328484-97f7-4afd-99ad-3506d6a46ba6" returned: 0 in 0.246s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-quobyte-6d328484-97f7-4afd-99ad-3506d6a46ba6" released by "delete_volume" :: held 0.638s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Created reservations ['70cc6c03-e9f2-4909-819e-fe32389ff265', '9ead541e-91ed-4e94-ae95-b19f2a36ef51', '4803d2f2-80fc-4373-a843-13b85406d12f', '7d8f70c4-fe10-4eac-8ae4-abd96ac548af'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:07 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:07 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:07 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:07 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:08 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Deleted volume successfully. Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-be0f8a88-c901-4f0d-935a-ba541f6727c1 tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-6d328484-97f7-4afd-99ad-3506d6a46ba6-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "cinder-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "cinder-quobyte-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-quobyte-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3" acquired by "delete_volume" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3bf0e3-503b-4e2b-9593-fb804482cd0c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:08 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3 Nov 03 20:30:08 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:08 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3" returned: 0 in 0.365s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:08 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3 Nov 03 20:30:08 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:08 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3" returned: 0 in 0.260s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-quobyte-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3" released by "delete_volume" :: held 0.667s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:08 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Created reservations ['99eeb42b-e8d0-4b1b-aea7-71bfa1060da9', '40cc6e49-9d9d-482a-9056-025bc4c806e3', '3c038729-337b-440b-92d5-932c1df442d3', 'e7036cd9-ce74-4d51-9ca7-fac5404e675c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:09 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:09 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:09 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:09 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Deleted volume successfully. Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-96f17ef8-8b17-475e-8866-ce8e93809f0f tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-83233ec6-5be0-4de3-aa21-a2e1c7aac3c3-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "cinder-f5de58b0-3693-4f01-a106-6cc2fdc89641-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-f5de58b0-3693-4f01-a106-6cc2fdc89641-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "cinder-quobyte-f5de58b0-3693-4f01-a106-6cc2fdc89641" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-quobyte-f5de58b0-3693-4f01-a106-6cc2fdc89641" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4385a3d-9e77-4f5b-ada3-96fb58676150]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:09 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641 Nov 03 20:30:09 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:09 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641" returned: 0 in 0.358s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:09 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641 Nov 03 20:30:09 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:10 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5de58b0-3693-4f01-a106-6cc2fdc89641" returned: 0 in 0.238s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-quobyte-f5de58b0-3693-4f01-a106-6cc2fdc89641" released by "delete_volume" :: held 0.637s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Created reservations ['17f8e359-b260-4083-8414-c160770eb39e', '51b92399-0b01-4ea2-a0ce-51bc40eba896', '36cfd2c7-60cd-4c32-8bb8-8aaf8af83e38', '544abe6c-9fe7-4b36-ab4e-ec064d2edf3e'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:10 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:10 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:10 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.250s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Deleted volume successfully. Nov 03 20:30:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-83febfcd-9257-4cd6-a321-3c2cfc6b1643 tempest-AttachVolumeNegativeTest-538561877 None] Lock "cinder-f5de58b0-3693-4f01-a106-6cc2fdc89641-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-6bdc6c78-81f9-4922-bc38-38a168c3cece req-f35e5b00-817e-48cf-ae44-60cdd9855eb5 tempest-TestStampPattern-1868899069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-6bdc6c78-81f9-4922-bc38-38a168c3cece req-f35e5b00-817e-48cf-ae44-60cdd9855eb5 tempest-TestStampPattern-1868899069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-6bdc6c78-81f9-4922-bc38-38a168c3cece req-f35e5b00-817e-48cf-ae44-60cdd9855eb5 tempest-TestStampPattern-1868899069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-6bdc6c78-81f9-4922-bc38-38a168c3cece req-f35e5b00-817e-48cf-ae44-60cdd9855eb5 tempest-TestStampPattern-1868899069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-75c0573c-0c53-4b3c-ac72-f26248f37468', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcb7a10a-f937-4c03-99ce-de7e32029edf', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:30:13 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-6bdc6c78-81f9-4922-bc38-38a168c3cece req-f35e5b00-817e-48cf-ae44-60cdd9855eb5 tempest-TestStampPattern-1868899069 None] attachment_update completed successfully. Nov 03 20:30:16 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-17922279-2e9e-4825-b76b-d798fe8f735f req-9811940d-a80c-45f0-9d8e-13344d598c89 tempest-TestStampPattern-1868899069 None] Terminate volume connection completed successfully. Nov 03 20:30:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-17922279-2e9e-4825-b76b-d798fe8f735f req-9811940d-a80c-45f0-9d8e-13344d598c89 tempest-TestStampPattern-1868899069 None] Deleting attachment fcb7a10a-f937-4c03-99ce-de7e32029edf. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Acquiring lock "cinder-75c0573c-0c53-4b3c-ac72-f26248f37468-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Lock "cinder-75c0573c-0c53-4b3c-ac72-f26248f37468-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Acquiring lock "cinder-quobyte-75c0573c-0c53-4b3c-ac72-f26248f37468" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-75c0573c-0c53-4b3c-ac72-f26248f37468" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c138e995-497d-4d8b-be11-c0b68627423a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:21 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468 Nov 03 20:30:21 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:21 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468" returned: 0 in 0.383s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:21 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468 Nov 03 20:30:21 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:21 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-75c0573c-0c53-4b3c-ac72-f26248f37468" returned: 0 in 0.274s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-75c0573c-0c53-4b3c-ac72-f26248f37468" released by "delete_volume" :: held 0.727s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Created reservations ['7e1ce824-0f1d-459f-8ad1-d9f9067cd211', '0f3f21bb-8364-44b2-87c8-db443d9d323f', '013a742f-f451-4a62-8bb3-896095376709', 'c0c11d4c-b868-4a35-b070-a50050eb6e7f'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:21 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:21 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:22 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.289s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:22 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Deleted volume successfully. Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952a10a8-af73-4abb-a01c-a4efe641a200 tempest-TestStampPattern-1868899069 None] Lock "cinder-75c0573c-0c53-4b3c-ac72-f26248f37468-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Acquiring lock "cinder-06c344d2-af5e-4cbf-807f-bc8c62f8df90-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Lock "cinder-06c344d2-af5e-4cbf-807f-bc8c62f8df90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Acquiring lock "cinder-quobyte-87232553-5382-412e-aad6-781456b43032" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-87232553-5382-412e-aad6-781456b43032" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Acquiring lock "cinder-quobyte-06c344d2-af5e-4cbf-807f-bc8c62f8df90" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-06c344d2-af5e-4cbf-807f-bc8c62f8df90" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Deleting offline snapshot 06c344d2-af5e-4cbf-807f-bc8c62f8df90 of volume 87232553-5382-412e-aad6-781456b43032 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] snapshot_file for this snap is: volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[555b804e-dae4-4466-94e4-d40688927085]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:22 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 Nov 03 20:30:22 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:22 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90" returned: 0 in 0.379s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87232553-5382-412e-aad6-781456b43032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1bd5f8-b8dc-4854-bb57-e40f0f862a5d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:23 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 Nov 03 20:30:23 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:23 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032" returned: 0 in 0.528s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:23 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 Nov 03 20:30:23 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:23 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:23 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:23 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90" returned: 0 in 0.371s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:23 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90 Nov 03 20:30:23 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:23 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.280s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:30:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:30:24 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032.06c344d2-af5e-4cbf-807f-bc8c62f8df90" returned: 0 in 0.257s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-06c344d2-af5e-4cbf-807f-bc8c62f8df90" released by "_delete_snapshot" :: held 1.656s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-87232553-5382-412e-aad6-781456b43032" released by "delete_snapshot" :: held 1.681s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:24 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Created reservations ['f9664d4c-b4e8-4f55-a044-6856ded0153a', 'ab0ed3ed-141e-405a-a3aa-543419b9ae99', '3df2d984-793b-4657-a15f-4d9d4b3a5c08', '2b0ff463-5d94-45e9-beec-d14aedae9cc3'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:24 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Delete snapshot completed successfully. Nov 03 20:30:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c907ed42-0e12-41a6-9733-2b423b37a16e tempest-TestStampPattern-1868899069 None] Lock "cinder-06c344d2-af5e-4cbf-807f-bc8c62f8df90-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-baeeb424-63f2-47b8-80b8-daf80f266cf6 tempest-GroupsV314Test-1418945393 None] Group tempest-GroupsV314Test-Group-1385641514: creating Nov 03 20:30:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-baeeb424-63f2-47b8-80b8-daf80f266cf6 tempest-GroupsV314Test-1418945393 None] Group tempest-GroupsV314Test-Group-1385641514: created successfully Nov 03 20:30:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-baeeb424-63f2-47b8-80b8-daf80f266cf6 tempest-GroupsV314Test-1418945393 None] Create group completed successfully. Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Flow 'volume_create_manager' (2c926b66-9987-4336-83a2-fe12401be543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740f00a5-3a1e-40b9-8b58-0591b6cdd0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740f00a5-3a1e-40b9-8b58-0591b6cdd0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-841670760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84bb42af-79f3-4e84-8f4a-e19f026fff26,host='devstack@QuobyteHD#QuobyteHD',id=25141cf7-e62f-4634-8b89-a810f53a6395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d7f6a863c240908c79951685d3675e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:27Z,use_quota=True,user_id='8114f52b57dc4b1ab1da19e0c4ded569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de8083f7-5a90-4dda-bfec-9e2c58591fad),volume_type_id=de8083f7-5a90-4dda-bfec-9e2c58591fad)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d60522-9b0a-4b92-8298-e9ab37a348f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d60522-9b0a-4b92-8298-e9ab37a348f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22707af-1cdd-4e58-bad6-b7298c21de47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22707af-1cdd-4e58-bad6-b7298c21de47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25141cf7-e62f-4634-8b89-a810f53a6395', 'volume_name': 'volume-25141cf7-e62f-4634-8b89-a810f53a6395', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cedac0-95ca-4050-a46c-e92a63c69087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cedac0-95ca-4050-a46c-e92a63c69087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cfe3b3-0b09-41ad-af4f-4f45faea14c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:26 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Volume 25141cf7-e62f-4634-8b89-a810f53a6395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25141cf7-e62f-4634-8b89-a810f53a6395', 'volume_size': 1} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84bb42af-79f3-4e84-8f4a-e19f026fff26,created_at=2026-11-03T19:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-841670760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84bb42af-79f3-4e84-8f4a-e19f026fff26,host='devstack@QuobyteHD#QuobyteHD',id=25141cf7-e62f-4634-8b89-a810f53a6395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d7f6a863c240908c79951685d3675e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:27Z,use_quota=True,user_id='8114f52b57dc4b1ab1da19e0c4ded569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de8083f7-5a90-4dda-bfec-9e2c58591fad),volume_type_id=de8083f7-5a90-4dda-bfec-9e2c58591fad)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Creating volume 25141cf7-e62f-4634-8b89-a810f53a6395 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:27 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:27 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 1073741824 Nov 03 20:30:27 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:27 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 1073741824" returned: 0 in 0.424s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:27 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 Nov 03 20:30:27 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:27 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395" returned: 0 in 0.241s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cfe3b3-0b09-41ad-af4f-4f45faea14c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25141cf7-e62f-4634-8b89-a810f53a6395', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01371bbd-3779-41a1-ae87-7ff2551b5ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:27 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Volume volume-25141cf7-e62f-4634-8b89-a810f53a6395 (25141cf7-e62f-4634-8b89-a810f53a6395): created successfully Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01371bbd-3779-41a1-ae87-7ff2551b5ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Flow 'volume_create_manager' (2c926b66-9987-4336-83a2-fe12401be543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:27 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5b54ac9b-4e41-480c-952a-32b6852d0f14 tempest-GroupsV314Test-1418945393 None] Created volume successfully. Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Acquiring lock "cinder-87232553-5382-412e-aad6-781456b43032-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Lock "cinder-87232553-5382-412e-aad6-781456b43032-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Acquiring lock "cinder-quobyte-87232553-5382-412e-aad6-781456b43032" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-87232553-5382-412e-aad6-781456b43032" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d082a39-fe7f-4202-9d2c-76bd1324c156]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:28 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 Nov 03 20:30:28 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:28 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Cloning volume 25141cf7-e62f-4634-8b89-a810f53a6395 to volume fdcecd0b-db37-4382-af73-a9707656bf58 Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Creating offline snapshot 8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 of volume 25141cf7-e62f-4634-8b89-a810f53a6395 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c355e5a6-8b6f-48cc-b2b9-8e7bce955239]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:28 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032" returned: 0 in 0.399s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:28 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032 Nov 03 20:30:28 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:28 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 Nov 03 20:30:28 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:28 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-87232553-5382-412e-aad6-781456b43032" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Lock "cinder-quobyte-87232553-5382-412e-aad6-781456b43032" released by "delete_volume" :: held 0.721s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Created reservations ['ec1fc130-ffe4-4ac3-b44d-ed1f63acc99d', '9495ed5c-e50c-4326-ac63-ea267794f169', 'ae0c220c-71b1-4429-a0b6-76113ec91e86', '4cff7aa1-5fff-4c78-8fb6-62272913f2d2'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:29 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395" returned: 0 in 0.389s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:29 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 1G Nov 03 20:30:29 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:29 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:29 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:29 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.249s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:29 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Deleted volume successfully. Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4bba2030-fc1b-4797-8ffc-a6f5408d3076 tempest-TestStampPattern-1868899069 None] Lock "cinder-87232553-5382-412e-aad6-781456b43032-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:29 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 1G" returned: 0 in 0.428s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25141cf7-e62f-4634-8b89-a810f53a6395 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:29 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25141cf7-e62f-4634-8b89-a810f53a6395 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 Nov 03 20:30:29 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:29 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25141cf7-e62f-4634-8b89-a810f53a6395 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909" returned: 0 in 0.323s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:29 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:30:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:29 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 Nov 03 20:30:29 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:30 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909" returned: 0 in 0.305s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:30 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.info Nov 03 20:30:30 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:30 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.info" returned: 0 in 0.280s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:30 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:30 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.info Nov 03 20:30:30 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:30 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.info" returned: 0 in 0.260s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Acquiring lock "cinder-quobyte-fdcecd0b-db37-4382-af73-a9707656bf58" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Lock "cinder-quobyte-fdcecd0b-db37-4382-af73-a9707656bf58" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] snapshot: 8e6e6c8b-9e6c-44b8-b6b6-e0d636663909, volume: fdcecd0b-db37-4382-af73-a9707656bf58, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8f01ac-5f3b-42f1-905d-10f8ae5157f7]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:30 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 Nov 03 20:30:30 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:31 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909" returned: 0 in 0.437s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25141cf7-e62f-4634-8b89-a810f53a6395(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:30:31 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2606fe-b4fb-4104-a417-f7d3d09f8b8f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:31 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 Nov 03 20:30:31 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:31 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395" returned: 0 in 0.373s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:30:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:30:31 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58 not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:30:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:31 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58 Nov 03 20:30:31 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:38 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58" returned: 0 in 7.101s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:38 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395, size 1024.00 MB, duration 7.10 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:30:38 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Converted 1024.00 MB image at 144.18 MB/s Nov 03 20:30:38 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:30:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:38 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58 Nov 03 20:30:38 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:39 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58" returned: 0 in 0.236s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Lock "cinder-quobyte-fdcecd0b-db37-4382-af73-a9707656bf58" released by "_copy_volume_from_snapshot" :: held 8.240s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Acquiring lock "cinder-quobyte-8e6e6c8b-9e6c-44b8-b6b6-e0d636663909" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Lock "cinder-quobyte-8e6e6c8b-9e6c-44b8-b6b6-e0d636663909" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Deleting offline snapshot 8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 of volume 25141cf7-e62f-4634-8b89-a810f53a6395 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] snapshot_file for this snap is: volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09269c7-9fad-456c-8219-13eaf710a056]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:39 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 Nov 03 20:30:39 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:39 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909" returned: 0 in 0.350s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25141cf7-e62f-4634-8b89-a810f53a6395(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0691b38-127e-489a-9a55-b3899c049d7b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:39 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 Nov 03 20:30:39 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:40 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395" returned: 0 in 0.589s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:40 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 Nov 03 20:30:40 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:40 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=51,cinder:SELECT=60,cinder:DELETE=5,cinder:INSERT=14 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:30:40 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909" returned: 0 in 0.356s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:40 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909 Nov 03 20:30:40 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:40 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395.8e6e6c8b-9e6c-44b8-b6b6-e0d636663909" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Lock "cinder-quobyte-8e6e6c8b-9e6c-44b8-b6b6-e0d636663909" released by "_delete_snapshot" :: held 1.653s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.124s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-44d4f46b-1e60-4554-aeba-d069c2349b23 tempest-GroupsV314Test-1418945393 None] Create group from source-group-84bb42af-79f3-4e84-8f4a-e19f026fff26 completed successfully. Nov 03 20:30:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Acquiring lock "cinder-quobyte-fdcecd0b-db37-4382-af73-a9707656bf58" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Lock "cinder-quobyte-fdcecd0b-db37-4382-af73-a9707656bf58" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:41 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3500103-54ef-4002-ae4f-a4f1ab15a1ca]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:41 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58 Nov 03 20:30:41 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:42 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58" returned: 0 in 0.394s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:42 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58 Nov 03 20:30:42 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:42 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fdcecd0b-db37-4382-af73-a9707656bf58" returned: 0 in 0.258s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Lock "cinder-quobyte-fdcecd0b-db37-4382-af73-a9707656bf58" released by "delete_volume" :: held 0.703s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Created reservations ['15b6c9c2-8ff9-4248-a5fd-2b27d8f4fe69'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:42 devstack cinder-volume[87342]: WARNING cinder.quota [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1001295149 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1001295149, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:30:42 devstack cinder-volume[87342]: WARNING cinder.quota [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1001295149 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1001295149, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Created reservations ['87fbdd63-2fc6-4e2c-aae4-29d885d73cb1', '97c0fada-b6a5-4940-a14b-82463097eb3e', '54f4ab59-efd5-439b-a181-b66b4a72cf32', 'f4c4ea7e-9311-40c1-8ba6-65db9d617f35'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:42 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:42 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:42 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:42 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ad08798f-d067-4cd8-b606-27ff2500cd50 tempest-GroupsV314Test-1418945393 None] Delete group completed successfully. Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Acquiring lock "cinder-quobyte-25141cf7-e62f-4634-8b89-a810f53a6395" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Lock "cinder-quobyte-25141cf7-e62f-4634-8b89-a810f53a6395" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[21810e25-929f-434f-b69e-0653de24a26e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:43 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 Nov 03 20:30:43 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:43 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395" returned: 0 in 0.368s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:43 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395 Nov 03 20:30:43 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:43 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-25141cf7-e62f-4634-8b89-a810f53a6395" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Lock "cinder-quobyte-25141cf7-e62f-4634-8b89-a810f53a6395" released by "delete_volume" :: held 0.689s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Created reservations ['3db125d2-646c-4f4a-a7ef-ad1e72590c96'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Created reservations ['6f1d59e9-b985-4adc-8fd4-3745e2cf106a', '583330d0-404c-4f2a-a818-7ff5a32685e1', '0602d77b-d30f-4ddf-bfad-42eadf959fba', '68acad43-81bc-42ee-a9c6-9c0049199e10'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (e2b3e6c9-e8dc-409e-988d-68c013248b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b49607-123a-4ae7-a628-658db46e13c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b49607-123a-4ae7-a628-658db46e13c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-791189740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e13d9c5-ea30-4da0-b80c-37cc363b09de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:44Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:44 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:44 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec55003c-667e-4f08-b202-ea1246607852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec55003c-667e-4f08-b202-ea1246607852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31861fc7-0693-46fe-b3bd-cadeccd8a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31861fc7-0693-46fe-b3bd-cadeccd8a059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e13d9c5-ea30-4da0-b80c-37cc363b09de', 'volume_name': 'volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b529c5-3035-4f8c-bf2e-3ac219055f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b529c5-3035-4f8c-bf2e-3ac219055f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d8b1db-a49f-4a51-8bb7-96c6403d1e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:44 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume 6e13d9c5-ea30-4da0-b80c-37cc363b09de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de', 'volume_size': 1} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-791189740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e13d9c5-ea30-4da0-b80c-37cc363b09de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:44Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Creating volume 6e13d9c5-ea30-4da0-b80c-37cc363b09de {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:44 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:44 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de 1073741824 Nov 03 20:30:44 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:44 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.254s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e365f40e-6e14-4e7f-b8df-87f4847d4b6c tempest-GroupsV314Test-1418945393 None] Delete group completed successfully. Nov 03 20:30:44 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de 1073741824" returned: 0 in 0.443s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:44 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de Nov 03 20:30:44 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:44 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de" returned: 0 in 0.252s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d8b1db-a49f-4a51-8bb7-96c6403d1e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221810f3-6d86-4a85-af90-7bcfb0229152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:44 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de (6e13d9c5-ea30-4da0-b80c-37cc363b09de): created successfully Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221810f3-6d86-4a85-af90-7bcfb0229152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (e2b3e6c9-e8dc-409e-988d-68c013248b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2ff8881b-6fc6-4e9f-b325-39375984f487 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created volume successfully. Nov 03 20:30:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] Creating offline snapshot 1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 of volume 6e13d9c5-ea30-4da0-b80c-37cc363b09de {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:30:45 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[35702850-ff51-456a-acb8-c9d0b58c40fb]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:45 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de Nov 03 20:30:45 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:45 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de" returned: 0 in 0.374s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:45 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 1G Nov 03 20:30:45 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:46 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 1G" returned: 0 in 0.434s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:46 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 Nov 03 20:30:46 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:46 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74" returned: 0 in 0.327s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:46 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 is being set with open permissions: ugo+rw Nov 03 20:30:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:46 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 Nov 03 20:30:46 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:46 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74" returned: 0 in 0.239s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:46 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.info Nov 03 20:30:46 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:46 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.info" returned: 0 in 0.275s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:46 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.info is being set with open permissions: ugo+rw Nov 03 20:30:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:46 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.info Nov 03 20:30:46 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:47 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.info" returned: 0 in 0.253s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:47 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-fac8abe3-7148-4929-b4ae-6af2350629ad tempest-CreateVolumesFromSnapshotTest-1599603422 None] Create snapshot completed successfully Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (7c34cdd5-7b39-4c60-a379-ba4d0a4f794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67772b3-37a4-4c99-957c-0e6f1aa96626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67772b3-37a4-4c99-957c-0e6f1aa96626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-321512736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace55d29-01a4-46cf-91c0-248eb1dea7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:49Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf223b96-e168-4071-943c-ca6f2f4d212f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf223b96-e168-4071-943c-ca6f2f4d212f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacda080-3391-4dc8-9754-e94eef78de57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacda080-3391-4dc8-9754-e94eef78de57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace55d29-01a4-46cf-91c0-248eb1dea7f0', 'volume_name': 'volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74132372-49c4-467f-b369-bb0b08d0a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74132372-49c4-467f-b369-bb0b08d0a334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bc270d-93e8-4442-b247-273ad0ee3568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:48 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume ace55d29-01a4-46cf-91c0-248eb1dea7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0', 'volume_size': 1} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-321512736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace55d29-01a4-46cf-91c0-248eb1dea7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:49Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Creating volume ace55d29-01a4-46cf-91c0-248eb1dea7f0 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:48 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:30:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:48 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0 1073741824 Nov 03 20:30:48 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (4efa45b1-0022-4c7a-8059-febab5a28540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1d41a2-8f70-4384-bbf1-ede73ead7ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1d41a2-8f70-4384-bbf1-ede73ead7ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1695825732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f80d82-4e62-43d5-b6cf-4ec946590d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:49Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02140b32-98d7-48fc-95b8-a1a8a25b6272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02140b32-98d7-48fc-95b8-a1a8a25b6272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d9d289-5501-4dc6-8f2c-04f52096dfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d9d289-5501-4dc6-8f2c-04f52096dfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f80d82-4e62-43d5-b6cf-4ec946590d4a', 'volume_name': 'volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7082ce16-3408-4ed8-a862-0676ddaf99bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7082ce16-3408-4ed8-a862-0676ddaf99bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0dc5ef8-4300-4b42-9319-723ca9e144da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:49 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume c5f80d82-4e62-43d5-b6cf-4ec946590d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a', 'volume_size': 1} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:49 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0 1073741824" returned: 0 in 0.596s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:49 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0 Nov 03 20:30:49 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (95a964e0-77a8-4226-89d6-4aa5e3e8ae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f43a75-fe3f-4850-9365-f6cd25cf1392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f43a75-fe3f-4850-9365-f6cd25cf1392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208025023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d0f090-6889-4adf-9d63-55989d910c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:50Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85387e20-50ed-41b3-a1b4-060045160538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85387e20-50ed-41b3-a1b4-060045160538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35dad2a-d87a-4373-be06-8e17e6982277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35dad2a-d87a-4373-be06-8e17e6982277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d0f090-6889-4adf-9d63-55989d910c78', 'volume_name': 'volume-a1d0f090-6889-4adf-9d63-55989d910c78', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2a1334-e1f6-48bd-a27c-a082702910cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2a1334-e1f6-48bd-a27c-a082702910cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed8ddce-def7-4e2e-b422-824551f3dcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:49 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume a1d0f090-6889-4adf-9d63-55989d910c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d0f090-6889-4adf-9d63-55989d910c78', 'volume_size': 1} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:49 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0" returned: 0 in 0.364s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1695825732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f80d82-4e62-43d5-b6cf-4ec946590d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:49Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Creating volume c5f80d82-4e62-43d5-b6cf-4ec946590d4a {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:49 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bc270d-93e8-4442-b247-273ad0ee3568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafbd055-10b3-4e2c-8b57-96a011bbb9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:49 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a 1073741824 Nov 03 20:30:49 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:49 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0 (ace55d29-01a4-46cf-91c0-248eb1dea7f0): created successfully Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafbd055-10b3-4e2c-8b57-96a011bbb9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (7c34cdd5-7b39-4c60-a379-ba4d0a4f794d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:50 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ce9d7e38-0b4a-4e70-9c90-415ad9d17f37 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created volume successfully. Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (85095bff-cdaf-467c-a881-1ad6f4f2e793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1c938a-1d2c-4df7-a633-2869fa044f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1c938a-1d2c-4df7-a633-2869fa044f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1072086725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c69647e-169b-4329-a4da-01d5146d3a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:50Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d326dd-8295-4989-a633-65327107bf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d326dd-8295-4989-a633-65327107bf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4485af-ae13-454e-b5b5-d9571ef3e603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4485af-ae13-454e-b5b5-d9571ef3e603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c69647e-169b-4329-a4da-01d5146d3a03', 'volume_name': 'volume-9c69647e-169b-4329-a4da-01d5146d3a03', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b20118-6057-4f92-8357-548f31564a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b20118-6057-4f92-8357-548f31564a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06debbf-7863-411b-bb12-6894c734fce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:50 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume 9c69647e-169b-4329-a4da-01d5146d3a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c69647e-169b-4329-a4da-01d5146d3a03', 'volume_size': 1} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:50 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a 1073741824" returned: 0 in 0.693s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:50 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a Nov 03 20:30:50 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:50 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.060s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208025023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d0f090-6889-4adf-9d63-55989d910c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:50Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Creating volume a1d0f090-6889-4adf-9d63-55989d910c78 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:50 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:50 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78 1073741824 Nov 03 20:30:50 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Flow 'volume_create_manager' (70b02a45-dbde-4edd-968e-bb535005a259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b31b92-1464-4017-8147-a632f641c8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0dc5ef8-4300-4b42-9319-723ca9e144da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0491ec83-6338-47ce-a418-6f13a724250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:51 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a (c5f80d82-4e62-43d5-b6cf-4ec946590d4a): created successfully Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0491ec83-6338-47ce-a418-6f13a724250c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (4efa45b1-0022-4c7a-8059-febab5a28540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b31b92-1464-4017-8147-a632f641c8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1526162713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881d2587-bc62-4a5d-8c09-12141a06e57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7814d432eb3341209734824d437ffb78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:51Z,use_quota=True,user_id='a828093dd70b491f9774c462d1828fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0990ae2c-f6ce-40da-a1c7-f73426b3a4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0990ae2c-f6ce-40da-a1c7-f73426b3a4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef06a0a-12d7-4ad7-bd55-7f93a307bd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef06a0a-12d7-4ad7-bd55-7f93a307bd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '881d2587-bc62-4a5d-8c09-12141a06e57d', 'volume_name': 'volume-881d2587-bc62-4a5d-8c09-12141a06e57d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ddabd4-2acc-49ee-820a-1aa3901ac478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ddabd4-2acc-49ee-820a-1aa3901ac478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d19f7b-db68-488c-9376-f8ce1a7b7a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:51 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Volume 881d2587-bc62-4a5d-8c09-12141a06e57d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-881d2587-bc62-4a5d-8c09-12141a06e57d', 'volume_size': 1} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (84d15650-0f20-4bbc-b191-111febd4a956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38d3ce2-9c29-45e5-8ac7-96bbb818330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-affb0acb-b9b0-419e-a8eb-626d1e4a5486 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created volume successfully. Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38d3ce2-9c29-45e5-8ac7-96bbb818330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902834348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c416b37d-34df-44e7-bbbf-5b115f4e56fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:51Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d6dd3-b230-4e56-8e21-a009f758b32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d6dd3-b230-4e56-8e21-a009f758b32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d400f95-4538-45c3-baaa-d14175a6d57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d400f95-4538-45c3-baaa-d14175a6d57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c416b37d-34df-44e7-bbbf-5b115f4e56fc', 'volume_name': 'volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7856cbb-4668-435c-94be-91169f3b1ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7856cbb-4668-435c-94be-91169f3b1ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2288b8f1-b0b1-4cfd-9b0f-4fc580365031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:51 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume c416b37d-34df-44e7-bbbf-5b115f4e56fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc', 'volume_size': 1} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:51 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78 1073741824" returned: 0 in 0.444s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:51 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78 Nov 03 20:30:51 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:51 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.230s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1072086725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c69647e-169b-4329-a4da-01d5146d3a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:50Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Creating volume 9c69647e-169b-4329-a4da-01d5146d3a03 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:51 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:51 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03 1073741824 Nov 03 20:30:51 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed8ddce-def7-4e2e-b422-824551f3dcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d0f090-6889-4adf-9d63-55989d910c78', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8981f55-20b6-4544-8511-e49135fd6e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:51 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume volume-a1d0f090-6889-4adf-9d63-55989d910c78 (a1d0f090-6889-4adf-9d63-55989d910c78): created successfully Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8981f55-20b6-4544-8511-e49135fd6e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (95a964e0-77a8-4226-89d6-4aa5e3e8ae26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2c4f0400-8315-40b2-8aef-d3c5ffe06747 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created volume successfully. Nov 03 20:30:52 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03 1073741824" returned: 0 in 0.434s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:52 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03 Nov 03 20:30:52 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:52 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03" returned: 0 in 0.234s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.301s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1526162713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881d2587-bc62-4a5d-8c09-12141a06e57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7814d432eb3341209734824d437ffb78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:51Z,use_quota=True,user_id='a828093dd70b491f9774c462d1828fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Creating volume 881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:52 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06debbf-7863-411b-bb12-6894c734fce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c69647e-169b-4329-a4da-01d5146d3a03', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:52 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d 1073741824 Nov 03 20:30:52 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f58a643-f4cc-4995-b219-2fecda3fef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:52 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume volume-9c69647e-169b-4329-a4da-01d5146d3a03 (9c69647e-169b-4329-a4da-01d5146d3a03): created successfully Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f58a643-f4cc-4995-b219-2fecda3fef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (85095bff-cdaf-467c-a881-1ad6f4f2e793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:52 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5c767dbf-4c87-43cf-82a0-022f7c2f18ae tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created volume successfully. Nov 03 20:30:52 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d 1073741824" returned: 0 in 0.407s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:52 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d Nov 03 20:30:52 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:53 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d" returned: 0 in 0.245s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.912s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902834348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c416b37d-34df-44e7-bbbf-5b115f4e56fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82af9d1be1040b08ca5ff5fe488a120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:51Z,use_quota=True,user_id='4bbf62b884c4489e98ebdd68d52559bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Creating volume c416b37d-34df-44e7-bbbf-5b115f4e56fc {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:53 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d19f7b-db68-488c-9376-f8ce1a7b7a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-881d2587-bc62-4a5d-8c09-12141a06e57d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:53 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc 1073741824 Nov 03 20:30:53 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa85459-8305-4fe2-a1ce-1dacf4b88a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:53 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Volume volume-881d2587-bc62-4a5d-8c09-12141a06e57d (881d2587-bc62-4a5d-8c09-12141a06e57d): created successfully Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa85459-8305-4fe2-a1ce-1dacf4b88a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Flow 'volume_create_manager' (70b02a45-dbde-4edd-968e-bb535005a259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:53 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-60602eeb-fc9d-4a77-9faa-fb7e65501f6a tempest-SnapshotsActionsTest-13460560 None] Created volume successfully. Nov 03 20:30:53 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc 1073741824" returned: 0 in 0.417s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:53 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc Nov 03 20:30:53 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:53 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc" returned: 0 in 0.245s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=91,cinder:UPDATE=108,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2288b8f1-b0b1-4cfd-9b0f-4fc580365031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37a9d02-631b-47a4-9e8d-b615158e2015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:53 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Volume volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc (c416b37d-34df-44e7-bbbf-5b115f4e56fc): created successfully Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37a9d02-631b-47a4-9e8d-b615158e2015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Flow 'volume_create_manager' (84d15650-0f20-4bbc-b191-111febd4a956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:53 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-24b4652b-4e81-4860-b5e4-4c42a36085d1 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created volume successfully. Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] Creating offline snapshot 0efbd8ce-0de0-4474-80b1-865a3b65b86d of volume 881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9394662-cda1-48a6-ae45-f4c1d8870f68]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:54 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d Nov 03 20:30:54 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-c416b37d-34df-44e7-bbbf-5b115f4e56fc-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-c416b37d-34df-44e7-bbbf-5b115f4e56fc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-quobyte-c416b37d-34df-44e7-bbbf-5b115f4e56fc" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-c416b37d-34df-44e7-bbbf-5b115f4e56fc" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0369b89-7a26-41f1-9bd7-c086dc10f2de]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:54 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc Nov 03 20:30:54 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:54 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d" returned: 0 in 0.384s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:54 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d 1G Nov 03 20:30:54 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:54 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc" returned: 0 in 0.384s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:54 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc Nov 03 20:30:54 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:54 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d 1G" returned: 0 in 0.414s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:54 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:30:54 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:54 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c416b37d-34df-44e7-bbbf-5b115f4e56fc" returned: 0 in 0.275s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-c416b37d-34df-44e7-bbbf-5b115f4e56fc" released by "delete_volume" :: held 0.705s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:54 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created reservations ['eebf8259-4e74-4012-b87f-9108f50cf77c', '0dd6d5ab-a3fb-4ef6-8ea5-b772cad70e04', 'c4d1a311-ad00-46ec-80b0-80573c119c42', 'c1dd9398-54db-4fcb-abb5-103f8f1f692d'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:55 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:55 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:55 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.316s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:55 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d is being set with open permissions: ugo+rw Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:55 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:30:55 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:55 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.258s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-9c69647e-169b-4329-a4da-01d5146d3a03-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:55 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Deleted volume successfully. Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-9c69647e-169b-4329-a4da-01d5146d3a03-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5defe5e6-69c4-4517-899e-2ebb05fbf477 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-c416b37d-34df-44e7-bbbf-5b115f4e56fc-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-quobyte-9c69647e-169b-4329-a4da-01d5146d3a03" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:55 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.263s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-9c69647e-169b-4329-a4da-01d5146d3a03" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e29b629-68dc-4689-baf5-86e29bc2e162]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:55 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.info Nov 03 20:30:55 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:55 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03 Nov 03 20:30:55 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:55 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.info" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:55 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.info is being set with open permissions: ugo+rw Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:55 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.info Nov 03 20:30:55 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:55 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03" returned: 0 in 0.370s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:55 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03 Nov 03 20:30:55 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:55 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.info" returned: 0 in 0.247s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:55 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-eed72a0d-8e55-4807-87d3-647ab369ecf6 tempest-SnapshotsActionsTest-13460560 None] Create snapshot completed successfully Nov 03 20:30:56 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c69647e-169b-4329-a4da-01d5146d3a03" returned: 0 in 0.269s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-9c69647e-169b-4329-a4da-01d5146d3a03" released by "delete_volume" :: held 0.690s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created reservations ['ad515e40-13c8-4235-8ba1-4b2425e87f1c', '30a3ff2f-2d27-4ee9-a712-3bacbf2939b8', 'd2f26245-1f98-48bd-be26-94a93574aef2', '0fb69e76-b706-4711-bbdc-824b39f91163'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:56 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:56 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:56 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.258s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:56 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Deleted volume successfully. Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-32a03b00-8cf0-4e4d-a2c1-f78fb05ab0cc tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-9c69647e-169b-4329-a4da-01d5146d3a03-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-a1d0f090-6889-4adf-9d63-55989d910c78-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-a1d0f090-6889-4adf-9d63-55989d910c78-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-quobyte-a1d0f090-6889-4adf-9d63-55989d910c78" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-a1d0f090-6889-4adf-9d63-55989d910c78" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a571e8e-d051-478e-bcd1-cedcbed60a3b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] Creating offline snapshot 79a630a6-2390-4f06-84cf-ec30c1782514 of volume 881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd492c6-0550-499d-8125-1acb8699cd37]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:56 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78 Nov 03 20:30:56 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:56 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:30:56 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:57 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78" returned: 0 in 0.391s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:57 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78 Nov 03 20:30:57 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:57 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.390s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:57 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 1G Nov 03 20:30:57 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:57 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a1d0f090-6889-4adf-9d63-55989d910c78" returned: 0 in 0.250s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-a1d0f090-6889-4adf-9d63-55989d910c78" released by "delete_volume" :: held 0.688s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created reservations ['ba11e9cb-18de-4303-9fc4-109e3b4bc774', '66b04506-3548-41ab-8636-48b88eb98b1e', '3ac2a5de-e926-488c-9b5d-62fed5d979cf', 'ab34ab2b-25c7-4255-a66d-8dde977ea14a'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:57 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:57 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:57 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 1G" returned: 0 in 0.447s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:57 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 Nov 03 20:30:57 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:57 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.288s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:57 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Deleted volume successfully. Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-c5f80d82-4e62-43d5-b6cf-4ec946590d4a-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-c5f80d82-4e62-43d5-b6cf-4ec946590d4a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-973b8a9c-5631-4c9e-9000-1ec68e08db86 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-a1d0f090-6889-4adf-9d63-55989d910c78-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-quobyte-c5f80d82-4e62-43d5-b6cf-4ec946590d4a" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-c5f80d82-4e62-43d5-b6cf-4ec946590d4a" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6389b0-3981-4e37-9c7d-f0cf70414f2f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:57 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514" returned: 0 in 0.323s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:57 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 is being set with open permissions: ugo+rw Nov 03 20:30:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:57 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 Nov 03 20:30:57 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:57 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a Nov 03 20:30:57 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:58 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514" returned: 0 in 0.253s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.523s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:58 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-58c08322-fe54-4c83-ac68-09bbd57c8652 tempest-SnapshotsActionsTest-13460560 None] Create snapshot completed successfully Nov 03 20:30:58 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a" returned: 0 in 0.396s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:58 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a Nov 03 20:30:58 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:58 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c5f80d82-4e62-43d5-b6cf-4ec946590d4a" returned: 0 in 0.241s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-c5f80d82-4e62-43d5-b6cf-4ec946590d4a" released by "delete_volume" :: held 0.678s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created reservations ['af21c2c8-233c-4f52-b2e5-64d28f3edd55', '3af55186-7da2-4375-94c1-e0a293c9ec6a', '9a3d3f67-d64c-4200-85bd-367ecf4b25b5', 'b79fdba1-dd0f-487c-b6c7-5b7c427cbd2b'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:58 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:58 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:58 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.273s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-79a630a6-2390-4f06-84cf-ec30c1782514-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:58 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Deleted volume successfully. Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-ace55d29-01a4-46cf-91c0-248eb1dea7f0-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-79a630a6-2390-4f06-84cf-ec30c1782514-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0db65e05-344f-4285-887a-9fefb44a1e4b tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-c5f80d82-4e62-43d5-b6cf-4ec946590d4a-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-quobyte-79a630a6-2390-4f06-84cf-ec30c1782514" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-ace55d29-01a4-46cf-91c0-248eb1dea7f0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-79a630a6-2390-4f06-84cf-ec30c1782514" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Deleting offline snapshot 79a630a6-2390-4f06-84cf-ec30c1782514 of volume 881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] snapshot_file for this snap is: volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[919564e7-eed0-4d13-a082-3d60faf71e3d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-quobyte-ace55d29-01a4-46cf-91c0-248eb1dea7f0" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-ace55d29-01a4-46cf-91c0-248eb1dea7f0" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeeec83-f139-4248-87ee-ea30ee09f20b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:59 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 Nov 03 20:30:59 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:59 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0 Nov 03 20:30:59 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:59 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514" returned: 0 in 0.365s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df73a68-fffc-44a1-bb0a-cdfd48db96f6]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:59 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0" returned: 0 in 0.375s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:59 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0 Nov 03 20:30:59 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:59 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:30:59 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:59 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ace55d29-01a4-46cf-91c0-248eb1dea7f0" returned: 0 in 0.246s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-ace55d29-01a4-46cf-91c0-248eb1dea7f0" released by "delete_volume" :: held 0.671s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created reservations ['aa7275de-aaf3-4517-8d87-9e08dbf98083', '72864003-c8ed-475b-8d42-81a2dde3ab99', '31b2127c-cf2b-4340-a932-89ceaaafe486', '84878ae8-bdc0-45f1-929e-24e37126c79f'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:59 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.380s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:59 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 Nov 03 20:30:59 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:59 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:30:59 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-1fe075c2-79cf-4b9f-9f0b-6d55a8074f74-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-1fe075c2-79cf-4b9f-9f0b-6d55a8074f74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-quobyte-6e13d9c5-ea30-4da0-b80c-37cc363b09de" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-6e13d9c5-ea30-4da0-b80c-37cc363b09de" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-quobyte-1fe075c2-79cf-4b9f-9f0b-6d55a8074f74" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:00 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-1fe075c2-79cf-4b9f-9f0b-6d55a8074f74" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Deleting offline snapshot 1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 of volume 6e13d9c5-ea30-4da0-b80c-37cc363b09de {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] snapshot_file for this snap is: volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.333s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:00 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Deleted volume successfully. Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d4e5af-f075-4270-b79a-0e2daea87839]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:00 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514" returned: 0 in 0.439s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cf3d7f80-8c4b-4db9-ae64-05300ca7b796 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-ace55d29-01a4-46cf-91c0-248eb1dea7f0-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:00 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514 Nov 03 20:31:00 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:00 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 Nov 03 20:31:00 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:00 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.79a630a6-2390-4f06-84cf-ec30c1782514" returned: 0 in 0.263s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-79a630a6-2390-4f06-84cf-ec30c1782514" released by "_delete_snapshot" :: held 1.562s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" released by "delete_snapshot" :: held 1.586s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:00 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74" returned: 0 in 0.367s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Created reservations ['e51e91bb-f02d-4a94-b4c9-626e209d7ccc', 'cbb4dede-f2aa-43b1-b442-70d2741b028a', 'b148ef68-4742-4eb3-bce3-b8d893c59fba', '7245a6bc-41b7-4536-bf5f-4211a17e4291'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9a4195-2daf-4817-8e4d-4284f86bef8b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:00 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Delete snapshot completed successfully. Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-fbae5e6e-56f0-4ea8-932b-fadee25d1c6a tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-79a630a6-2390-4f06-84cf-ec30c1782514-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:00 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de Nov 03 20:31:00 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:00 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de" returned: 0 in 0.354s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:00 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 Nov 03 20:31:00 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:01 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74" returned: 0 in 0.382s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:01 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74 Nov 03 20:31:01 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] Creating offline snapshot 1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 of volume 881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2079d5c-496c-435a-bb9a-357b87bea373]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:01 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:31:01 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:01 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de.1fe075c2-79cf-4b9f-9f0b-6d55a8074f74" returned: 0 in 0.288s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-1fe075c2-79cf-4b9f-9f0b-6d55a8074f74" released by "_delete_snapshot" :: held 1.514s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-6e13d9c5-ea30-4da0-b80c-37cc363b09de" released by "delete_snapshot" :: held 1.542s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created reservations ['7b903cb9-f796-4f63-827f-79eea86af9e3', '63a31a51-9531-49f6-8a1a-0208fa79f297', '0fb08580-957f-4fe0-a76a-300ffde9e654', '0a6bdaf6-1f2f-43a4-b379-bc905128bf87'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:01 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Delete snapshot completed successfully. Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-49232d60-5aa2-41a5-95f6-c52a1ec667f9 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-1fe075c2-79cf-4b9f-9f0b-6d55a8074f74-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:01 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.409s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:31:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:01 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 1G Nov 03 20:31:01 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-6e13d9c5-ea30-4da0-b80c-37cc363b09de-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-6e13d9c5-ea30-4da0-b80c-37cc363b09de-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:02 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 1G" returned: 0 in 0.456s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "cinder-quobyte-6e13d9c5-ea30-4da0-b80c-37cc363b09de" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:02 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 Nov 03 20:31:02 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-6e13d9c5-ea30-4da0-b80c-37cc363b09de" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6880d37-18ba-43d9-8a7e-b51de23ceff3]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:02 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de Nov 03 20:31:02 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:02 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0" returned: 0 in 0.315s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:02 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 is being set with open permissions: ugo+rw Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:02 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 Nov 03 20:31:02 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:02 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de" returned: 0 in 0.395s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:02 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de Nov 03 20:31:02 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:02 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0" returned: 0 in 0.264s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.546s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:02 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-9ba446ed-7408-476a-b7bb-02714ff400c8 tempest-SnapshotsActionsTest-13460560 None] Create snapshot completed successfully Nov 03 20:31:03 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6e13d9c5-ea30-4da0-b80c-37cc363b09de" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-quobyte-6e13d9c5-ea30-4da0-b80c-37cc363b09de" released by "delete_volume" :: held 0.707s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Created reservations ['e256fb07-11f9-4fcf-9c9f-d104bbd4e5f0', '0c79b4d5-3339-4a41-9ccb-46f657508a67', 'c28bc78d-43f3-42d5-a43d-4eceb5af6346', '4fa247f4-d380-4fa4-88a6-9d7f6c9371eb'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:03 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:03 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:03 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.249s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:03 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Deleted volume successfully. Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d82d7277-8818-4d43-8a58-7385babbb356 tempest-CreateVolumesFromSnapshotTest-1599603422 None] Lock "cinder-6e13d9c5-ea30-4da0-b80c-37cc363b09de-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-quobyte-1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Deleting offline snapshot 1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 of volume 881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] snapshot_file for this snap is: volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[80684452-a5f5-4988-ba03-9a53e8239abe]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:03 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 Nov 03 20:31:03 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:04 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0" returned: 0 in 0.390s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:31:04 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6ded8f-07f3-46ff-be69-f2ebdcef3510]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:04 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:31:04 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:04 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.395s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:31:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:04 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 Nov 03 20:31:04 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:04 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0" returned: 0 in 0.464s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:04 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0 Nov 03 20:31:04 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:05 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0" returned: 0 in 0.252s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0" released by "_delete_snapshot" :: held 1.609s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" released by "delete_snapshot" :: held 1.633s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:05 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Created reservations ['2b6b5d28-6de3-4bcb-b4ae-a10e9f43f5bc', '830253f7-ec9a-40b2-99f6-ed96612ef060', 'c31f7dcc-172b-4f9d-9d1a-f1cc6865bfd5', 'ae5cc29c-7aa3-43c6-852e-606f8691f317'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:05 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Delete snapshot completed successfully. Nov 03 20:31:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c5a23ef1-d6e8-4cf9-8cf7-b7e5844c6790 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-1ec18b3a-b2f7-41ae-a559-4b57c2aca1b0-delete_snapshot" released by "delete_snapshot" :: held 1.777s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] Creating offline snapshot fc5d7019-6558-4b9a-b2a0-a3cc4d436698 of volume 881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50cc094-1c3c-4139-b914-088c2fa3a85d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:06 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:31:06 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (b17bbf39-dffc-4060-a4db-1374ad386ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3248c194-a7c9-4156-8ede-2fbdddb99926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3248c194-a7c9-4156-8ede-2fbdddb99926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1080354573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16aa37a-6488-44b8-a2aa-2c01252bd74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:06Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f48321-d73d-4022-bf4f-6db56797bf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f48321-d73d-4022-bf4f-6db56797bf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf575798-e806-4a00-b36f-bded15646de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf575798-e806-4a00-b36f-bded15646de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd16aa37a-6488-44b8-a2aa-2c01252bd74e', 'volume_name': 'volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd74304-861c-42b1-91fc-2880c7cd1154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd74304-861c-42b1-91fc-2880c7cd1154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:06 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5893136-229b-4452-b45d-51905799981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:06 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume d16aa37a-6488-44b8-a2aa-2c01252bd74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e', 'volume_size': 1} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.391s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:06 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 1G Nov 03 20:31:06 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:06 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 1G" returned: 0 in 0.429s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:06 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 Nov 03 20:31:06 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:07 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698" returned: 0 in 0.278s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:07 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 is being set with open permissions: ugo+rw Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:07 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 Nov 03 20:31:07 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:07 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698" returned: 0 in 0.233s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.451s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.981s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1080354573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16aa37a-6488-44b8-a2aa-2c01252bd74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:06Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Creating volume d16aa37a-6488-44b8-a2aa-2c01252bd74e {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:07 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:07 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e 1073741824 Nov 03 20:31:07 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:07 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-eff24fa1-2f25-49ab-8b05-24fc1d579233 tempest-SnapshotsActionsTest-13460560 None] Create snapshot completed successfully Nov 03 20:31:07 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e 1073741824" returned: 0 in 0.401s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:07 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e Nov 03 20:31:07 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:08 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e" returned: 0 in 0.245s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5893136-229b-4452-b45d-51905799981c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e66e05b-51cf-4f42-bab7-c57189d1926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:08 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e (d16aa37a-6488-44b8-a2aa-2c01252bd74e): created successfully Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e66e05b-51cf-4f42-bab7-c57189d1926b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (b17bbf39-dffc-4060-a4db-1374ad386ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-fc5d7019-6558-4b9a-b2a0-a3cc4d436698-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:08 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-55c6f498-bbd4-4f28-9cc3-a3a0ac201d46 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created volume successfully. Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-fc5d7019-6558-4b9a-b2a0-a3cc4d436698-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-quobyte-fc5d7019-6558-4b9a-b2a0-a3cc4d436698" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-fc5d7019-6558-4b9a-b2a0-a3cc4d436698" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Deleting offline snapshot fc5d7019-6558-4b9a-b2a0-a3cc4d436698 of volume 881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] snapshot_file for this snap is: volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f53a40f-b7b9-42c8-a4e6-5a1b4258b248]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:08 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 Nov 03 20:31:08 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:08 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698" returned: 0 in 0.366s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ff0262-b1ba-4705-bc1e-5b95e13275da]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:08 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:31:08 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (9eb28b8d-3b24-4f00-88c3-7c0807837ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b320b52c-8724-452f-a721-95fd787f2f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b320b52c-8724-452f-a721-95fd787f2f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-432766221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17954e17-bb33-4614-9ad1-9eddb878b6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:09Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e571833-9687-4108-ba11-f50885ce974f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e571833-9687-4108-ba11-f50885ce974f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b20aaa8-59e4-4bd3-bc6c-319494371704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b20aaa8-59e4-4bd3-bc6c-319494371704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17954e17-bb33-4614-9ad1-9eddb878b6f3', 'volume_name': 'volume-17954e17-bb33-4614-9ad1-9eddb878b6f3', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5e9b6e-7af3-40b3-83f4-465c58fffe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5e9b6e-7af3-40b3-83f4-465c58fffe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7952b8c-0cc0-4e55-831e-7dbe4aac5283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume 17954e17-bb33-4614-9ad1-9eddb878b6f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17954e17-bb33-4614-9ad1-9eddb878b6f3', 'volume_size': 1} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-432766221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17954e17-bb33-4614-9ad1-9eddb878b6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:09Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Creating volume 17954e17-bb33-4614-9ad1-9eddb878b6f3 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:09 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:09 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3 1073741824 Nov 03 20:31:09 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:09 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.422s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:09 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 Nov 03 20:31:09 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (7df51757-84ec-414a-bf48-0feef68c90ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c02b22-516f-44a3-97b9-8b66838a7020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c02b22-516f-44a3-97b9-8b66838a7020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1093943998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b379fa-cf98-4823-9e2c-2608ebd3707e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:09Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a90f9e-9346-4ae5-b998-05fb2d60f729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a90f9e-9346-4ae5-b998-05fb2d60f729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbb7ebf-b612-4d73-b750-ed76e9a220ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbb7ebf-b612-4d73-b750-ed76e9a220ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b379fa-cf98-4823-9e2c-2608ebd3707e', 'volume_name': 'volume-41b379fa-cf98-4823-9e2c-2608ebd3707e', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d87258-63f0-4de1-82d6-9d8a33ffcd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d87258-63f0-4de1-82d6-9d8a33ffcd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a01ba07-130a-47d9-8898-1319aae0c2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume 41b379fa-cf98-4823-9e2c-2608ebd3707e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b379fa-cf98-4823-9e2c-2608ebd3707e', 'volume_size': 1} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:09 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3 1073741824" returned: 0 in 0.557s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:09 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698" returned: 0 in 0.502s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:09 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3 Nov 03 20:31:09 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:09 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698 Nov 03 20:31:09 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (bb697c98-6c51-4e4e-9b90-4394ab7d9680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94431ae1-5c02-41a6-a1d5-8608e1dd69ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94431ae1-5c02-41a6-a1d5-8608e1dd69ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1662865492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:10Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a846190-a44b-46f9-8635-857a4029a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a846190-a44b-46f9-8635-857a4029a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3509cc19-b2a3-4a1a-895d-34a3b9ba1e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3509cc19-b2a3-4a1a-895d-34a3b9ba1e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac', 'volume_name': 'volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8464097-f179-42bb-893c-89a587da3be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8464097-f179-42bb-893c-89a587da3be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4edd448c-6f0b-48dd-854a-682522f1b773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:09 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume 93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac', 'volume_size': 1} Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:09 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.fc5d7019-6558-4b9a-b2a0-a3cc4d436698" returned: 0 in 0.315s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:09 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3" returned: 0 in 0.362s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.577s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1093943998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b379fa-cf98-4823-9e2c-2608ebd3707e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:09Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Creating volume 41b379fa-cf98-4823-9e2c-2608ebd3707e {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:10 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-fc5d7019-6558-4b9a-b2a0-a3cc4d436698" released by "_delete_snapshot" :: held 1.761s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7952b8c-0cc0-4e55-831e-7dbe4aac5283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17954e17-bb33-4614-9ad1-9eddb878b6f3', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f1b741-1af1-4ba8-b6ad-f422c393b6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e 1073741824 Nov 03 20:31:10 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" released by "delete_snapshot" :: held 1.807s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:10 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume volume-17954e17-bb33-4614-9ad1-9eddb878b6f3 (17954e17-bb33-4614-9ad1-9eddb878b6f3): created successfully Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f1b741-1af1-4ba8-b6ad-f422c393b6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (9eb28b8d-3b24-4f00-88c3-7c0807837ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c4385b2e-af38-4295-9b15-7b6f94b3e723 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created volume successfully. Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (efeb256f-a496-4431-b80d-6dbac0f0c7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b153a90-151a-4f7f-8935-5109d98ecb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b153a90-151a-4f7f-8935-5109d98ecb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959681139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ff0100-40da-4423-94ff-321fbc43bc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:10Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb31366-f3eb-4aad-9bd8-b20a44d93161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb31366-f3eb-4aad-9bd8-b20a44d93161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3133bbb-c74d-4f09-8f4d-93d36d3a3957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3133bbb-c74d-4f09-8f4d-93d36d3a3957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ff0100-40da-4423-94ff-321fbc43bc14', 'volume_name': 'volume-44ff0100-40da-4423-94ff-321fbc43bc14', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f415b80-baec-4d8e-9c07-c10a21f77ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f415b80-baec-4d8e-9c07-c10a21f77ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757d2ff4-2978-48e9-8f8b-d7d2eaf256d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume 44ff0100-40da-4423-94ff-321fbc43bc14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ff0100-40da-4423-94ff-321fbc43bc14', 'volume_size': 1} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Created reservations ['3940b035-f52a-4ed4-bf53-5c58bbf7108b', 'adc7fc52-abdb-4886-b3ab-12d9e8c39e97', 'dfd89b5e-c784-4660-b537-0644f6928118', 'a83ff975-15b4-40e5-b8db-92176acf1d36'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Delete snapshot completed successfully. Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-66a6e136-3e06-4a5d-9244-c1227754bbb0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-fc5d7019-6558-4b9a-b2a0-a3cc4d436698-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:10 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (fae7e317-7ed0-49bd-80ab-a32f37cd8477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb9a729-1cbf-41f0-9185-40b8cb8d9cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e 1073741824" returned: 0 in 0.575s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb9a729-1cbf-41f0-9185-40b8cb8d9cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-801983394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4099f95e-199e-4104-bbce-543fab80ed3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:11Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526d07e3-9b76-4658-a422-0471b3d59d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526d07e3-9b76-4658-a422-0471b3d59d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdebd6d-3b48-4831-bfba-9333ac719f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdebd6d-3b48-4831-bfba-9333ac719f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4099f95e-199e-4104-bbce-543fab80ed3f', 'volume_name': 'volume-4099f95e-199e-4104-bbce-543fab80ed3f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88dd2b6-0707-4866-add6-851c5f06c4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88dd2b6-0707-4866-add6-851c5f06c4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c2f0b9-4cce-4cca-ba02-84725ca798ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume 4099f95e-199e-4104-bbce-543fab80ed3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4099f95e-199e-4104-bbce-543fab80ed3f', 'volume_size': 1} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:10 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e Nov 03 20:31:10 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:10 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e" returned: 0 in 0.254s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.033s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1662865492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:10Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Creating volume 93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:10 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a01ba07-130a-47d9-8898-1319aae0c2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b379fa-cf98-4823-9e2c-2608ebd3707e', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac 1073741824 Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490c9968-2c18-4a28-a184-f1fdb66e9015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:10 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:10 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume volume-41b379fa-cf98-4823-9e2c-2608ebd3707e (41b379fa-cf98-4823-9e2c-2608ebd3707e): created successfully Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490c9968-2c18-4a28-a184-f1fdb66e9015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (7df51757-84ec-414a-bf48-0feef68c90ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ca5d2312-e20d-49af-b9f6-36fa8c312708 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created volume successfully. Nov 03 20:31:11 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac 1073741824" returned: 0 in 0.411s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:11 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac Nov 03 20:31:11 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:11 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac" returned: 0 in 0.264s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959681139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ff0100-40da-4423-94ff-321fbc43bc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:10Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Creating volume 44ff0100-40da-4423-94ff-321fbc43bc14 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:11 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:11 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14 1073741824 Nov 03 20:31:11 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4edd448c-6f0b-48dd-854a-682522f1b773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ab0961-944a-4192-8adc-414d7680ca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:11 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac (93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac): created successfully Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ab0961-944a-4192-8adc-414d7680ca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (bb697c98-6c51-4e4e-9b90-4394ab7d9680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:11 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ef188e4b-16f2-4c1b-afe4-6cb3a85040f9 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created volume successfully. Nov 03 20:31:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:12 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14 1073741824" returned: 0 in 0.423s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:12 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14 Nov 03 20:31:12 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:12 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14" returned: 0 in 0.252s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.724s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-801983394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4099f95e-199e-4104-bbce-543fab80ed3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6be1f5df9d4c0d9f4737e71afacac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:11Z,use_quota=True,user_id='0cb115204452489688ea6b5df65872dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Creating volume 4099f95e-199e-4104-bbce-543fab80ed3f {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:12 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757d2ff4-2978-48e9-8f8b-d7d2eaf256d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ff0100-40da-4423-94ff-321fbc43bc14', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:12 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f 1073741824 Nov 03 20:31:12 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8faf3277-9508-4f33-8894-0da6ca3cb788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:12 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume volume-44ff0100-40da-4423-94ff-321fbc43bc14 (44ff0100-40da-4423-94ff-321fbc43bc14): created successfully Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8faf3277-9508-4f33-8894-0da6ca3cb788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (efeb256f-a496-4431-b80d-6dbac0f0c7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:12 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7e3daabf-56c2-4eba-b691-d792252f467b tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created volume successfully. Nov 03 20:31:12 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f 1073741824" returned: 0 in 0.452s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:12 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f Nov 03 20:31:12 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:13 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f" returned: 0 in 0.236s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.322s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c2f0b9-4cce-4cca-ba02-84725ca798ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4099f95e-199e-4104-bbce-543fab80ed3f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73a3e31-77c0-48fb-9947-8d850665cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] Creating offline snapshot 251bbd09-4bbf-4620-8bae-027aa750cd6b of volume 881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:31:13 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Volume volume-4099f95e-199e-4104-bbce-543fab80ed3f (4099f95e-199e-4104-bbce-543fab80ed3f): created successfully Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73a3e31-77c0-48fb-9947-8d850665cf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Flow 'volume_create_manager' (fae7e317-7ed0-49bd-80ab-a32f37cd8477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7382e778-706a-44f4-909a-b41c70b2d97a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:13 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-041fe8a5-173f-415d-a149-23980bc130d8 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created volume successfully. Nov 03 20:31:13 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:31:13 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:13 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.352s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:13 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b 1G Nov 03 20:31:13 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-4099f95e-199e-4104-bbce-543fab80ed3f-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-4099f95e-199e-4104-bbce-543fab80ed3f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-quobyte-4099f95e-199e-4104-bbce-543fab80ed3f" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-4099f95e-199e-4104-bbce-543fab80ed3f" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:14 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b 1G" returned: 0 in 0.485s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3169cc-0795-4b7d-93fe-ed4d9bdd42a6]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:14 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b Nov 03 20:31:14 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:14 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f Nov 03 20:31:14 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:14 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b" returned: 0 in 0.282s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:14 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b is being set with open permissions: ugo+rw Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:14 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b Nov 03 20:31:14 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:14 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f" returned: 0 in 0.380s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:14 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f Nov 03 20:31:14 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:14 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b" returned: 0 in 0.254s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.500s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:14 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5776aa2e-570a-4f8c-a7da-f7afdaf03d61 tempest-SnapshotsActionsTest-13460560 None] Create snapshot completed successfully Nov 03 20:31:14 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4099f95e-199e-4104-bbce-543fab80ed3f" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-4099f95e-199e-4104-bbce-543fab80ed3f" released by "delete_volume" :: held 0.677s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created reservations ['d0077017-0f6e-4e67-981a-8f784569aa41', '07b4489a-6c80-4e6d-9f46-7e57f6a2b3cf', '75645f0b-c8ce-4358-bbe6-dafb2416aced', 'da613ed7-5b67-46d7-80b2-ede69eb8c315'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:14 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:14 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-251bbd09-4bbf-4620-8bae-027aa750cd6b-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-251bbd09-4bbf-4620-8bae-027aa750cd6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Acquiring lock "cinder-quobyte-251bbd09-4bbf-4620-8bae-027aa750cd6b" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:15 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:15 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Deleted volume successfully. Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-251bbd09-4bbf-4620-8bae-027aa750cd6b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Deleting offline snapshot 251bbd09-4bbf-4620-8bae-027aa750cd6b of volume 881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] snapshot_file for this snap is: volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-44ff0100-40da-4423-94ff-321fbc43bc14-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3da4c009-fb76-475a-94d9-cd4e32db1388 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-4099f95e-199e-4104-bbce-543fab80ed3f-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7639b6-e5e5-4818-879b-637170ee54dd]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-44ff0100-40da-4423-94ff-321fbc43bc14-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-quobyte-44ff0100-40da-4423-94ff-321fbc43bc14" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-44ff0100-40da-4423-94ff-321fbc43bc14" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[94be8a22-0173-423b-8142-d02a7f29dbce]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:15 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b Nov 03 20:31:15 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:15 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14 Nov 03 20:31:15 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:15 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b" returned: 0 in 0.380s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5f0f82-ae71-433b-b9cd-5a8e13e3082d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:15 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14" returned: 0 in 0.369s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:15 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14 Nov 03 20:31:15 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:15 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:31:15 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:15 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-44ff0100-40da-4423-94ff-321fbc43bc14" returned: 0 in 0.239s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-44ff0100-40da-4423-94ff-321fbc43bc14" released by "delete_volume" :: held 0.652s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created reservations ['af49ab21-81cf-4c41-8186-d724084fb58e', 'cbfdb1f6-4f28-4756-882a-5489218d452c', 'b6667929-d987-4e2a-bb92-b630317da319', 'dcb3c6c6-48db-45df-bcbd-474c8a5ecd61'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:15 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.380s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:15 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b Nov 03 20:31:15 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:16 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:16 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:16 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.262s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:16 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Deleted volume successfully. Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-79eed31a-5f54-4deb-b646-199dbcf5b93a tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-44ff0100-40da-4423-94ff-321fbc43bc14-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-quobyte-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:16 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b" returned: 0 in 0.460s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70ba625-cc66-4e60-867e-addc1fed96a3]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:16 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b Nov 03 20:31:16 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:16 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac Nov 03 20:31:16 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:16 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.251bbd09-4bbf-4620-8bae-027aa750cd6b" returned: 0 in 0.254s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-251bbd09-4bbf-4620-8bae-027aa750cd6b" released by "_delete_snapshot" :: held 1.601s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" released by "delete_snapshot" :: held 1.635s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Created reservations ['7285d4a7-fbda-4265-8455-fec943fc5958', 'acfa62b8-7d6d-4c04-a923-32344e4cf303', '75e317e5-b9ce-4666-80e4-e20094df2f5a', 'ca3cfc6f-fe7e-4353-b37f-9902511b5914'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:16 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac" returned: 0 in 0.393s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:16 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac Nov 03 20:31:16 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:16 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Delete snapshot completed successfully. Nov 03 20:31:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c1922e7c-4862-4c52-9785-46671a87bef0 tempest-SnapshotsActionsTest-511988233 None] Lock "cinder-251bbd09-4bbf-4620-8bae-027aa750cd6b-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:17 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac" returned: 0 in 0.251s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac" released by "delete_volume" :: held 0.689s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created reservations ['b6444602-3bfa-434d-bd04-f801b6bc862e', '3c55aa90-3744-4421-852a-c43b00d7c689', '59b6062e-dbfb-424a-a534-ae3145b7ecd7', '549513f7-fb5e-4e03-830f-c1a484842790'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:17 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:17 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:17 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.260s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Deleted volume successfully. Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a38c8042-fdbe-44a0-97b0-94f9bbd457ad tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-93e8bc5d-401f-4ab7-a722-f1bfe9ac3bac-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-41b379fa-cf98-4823-9e2c-2608ebd3707e-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-41b379fa-cf98-4823-9e2c-2608ebd3707e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-quobyte-41b379fa-cf98-4823-9e2c-2608ebd3707e" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-41b379fa-cf98-4823-9e2c-2608ebd3707e" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e7f0a6-f3b5-4548-9fe8-73674a74be16]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:17 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e Nov 03 20:31:17 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "cinder-0efbd8ce-0de0-4474-80b1-865a3b65b86d-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Lock "cinder-0efbd8ce-0de0-4474-80b1-865a3b65b86d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "cinder-quobyte-0efbd8ce-0de0-4474-80b1-865a3b65b86d" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Lock "cinder-quobyte-0efbd8ce-0de0-4474-80b1-865a3b65b86d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Deleting offline snapshot 0efbd8ce-0de0-4474-80b1-865a3b65b86d of volume 881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] snapshot_file for this snap is: volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d96c1f2-0ab6-45d0-b39d-9245a3bf6381]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:17 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:31:17 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:17 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e" returned: 0 in 0.403s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:18 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e Nov 03 20:31:18 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:18 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.372s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881d2587-bc62-4a5d-8c09-12141a06e57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8099f717-0e05-4983-8c1d-9e2aea74435c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:18 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-41b379fa-cf98-4823-9e2c-2608ebd3707e" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-41b379fa-cf98-4823-9e2c-2608ebd3707e" released by "delete_volume" :: held 0.715s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created reservations ['18ec829a-390c-48b8-a158-ded6c1455717', '98a85106-a1ff-4308-bd3c-935345db80e5', 'c91beba8-6b2e-4885-9460-507574808df3', '01e57e75-18e1-4768-b50f-6363bb74451d'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:18 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d Nov 03 20:31:18 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:18 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:18 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:18 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d" returned: 0 in 0.381s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-17954e17-bb33-4614-9ad1-9eddb878b6f3-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:18 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:18 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:31:18 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.271s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:18 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Deleted volume successfully. Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-17954e17-bb33-4614-9ad1-9eddb878b6f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-342195e7-b4c6-4a78-9f92-2d282d003a28 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-41b379fa-cf98-4823-9e2c-2608ebd3707e-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-quobyte-17954e17-bb33-4614-9ad1-9eddb878b6f3" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-17954e17-bb33-4614-9ad1-9eddb878b6f3" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c713fc-e073-4b1a-8ee1-2b43984b5f54]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:18 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3 Nov 03 20:31:18 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:18 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.375s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:19 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d Nov 03 20:31:19 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:19 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3" returned: 0 in 0.358s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:19 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3 Nov 03 20:31:19 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:19 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d.0efbd8ce-0de0-4474-80b1-865a3b65b86d" returned: 0 in 0.257s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Lock "cinder-quobyte-0efbd8ce-0de0-4474-80b1-865a3b65b86d" released by "_delete_snapshot" :: held 1.507s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" released by "delete_snapshot" :: held 1.536s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Created reservations ['905a74cd-ab1c-4e38-a1ef-d80ec253c567', 'f2c050fa-51fd-44dd-8a0f-21aaf2ec984c', 'ae57e9f4-7091-4d94-8c04-6b14f6c3b678', '1c598022-2e99-4730-94fb-3c8b45a9f03e'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:19 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-17954e17-bb33-4614-9ad1-9eddb878b6f3" returned: 0 in 0.268s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-17954e17-bb33-4614-9ad1-9eddb878b6f3" released by "delete_volume" :: held 0.674s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:19 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Delete snapshot completed successfully. Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f46d7714-02ce-43d3-8c0d-4168acd987e7 tempest-SnapshotsActionsTest-13460560 None] Lock "cinder-0efbd8ce-0de0-4474-80b1-865a3b65b86d-delete_snapshot" released by "delete_snapshot" :: held 1.691s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created reservations ['c0a4d0ff-314e-478a-9ff3-d50648e2bbfd', '01197a7d-89aa-4335-8129-8b3a0c76b6bb', 'e5e2498d-462c-410b-9bad-49b311c49275', 'e66554d9-0ce5-43b2-bb69-38f9b02a483f'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:19 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:19 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:19 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.238s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:19 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Deleted volume successfully. Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-77e02398-970e-4d5d-94ee-b0ba6acf9da5 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-17954e17-bb33-4614-9ad1-9eddb878b6f3-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-d16aa37a-6488-44b8-a2aa-2c01252bd74e-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-d16aa37a-6488-44b8-a2aa-2c01252bd74e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "cinder-quobyte-d16aa37a-6488-44b8-a2aa-2c01252bd74e" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-d16aa37a-6488-44b8-a2aa-2c01252bd74e" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb80e3a-86ba-44fb-99f9-ee1a2b5416cf]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "cinder-881d2587-bc62-4a5d-8c09-12141a06e57d-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Lock "cinder-881d2587-bc62-4a5d-8c09-12141a06e57d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" acquired by "delete_volume" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:20 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e Nov 03 20:31:20 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c65a77-4ef1-49d0-a52f-770af71efb49]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:20 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d Nov 03 20:31:20 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:20 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e" returned: 0 in 0.392s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:20 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e Nov 03 20:31:20 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:20 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d" returned: 0 in 0.363s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:20 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d Nov 03 20:31:20 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:20 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d16aa37a-6488-44b8-a2aa-2c01252bd74e" returned: 0 in 0.247s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-quobyte-d16aa37a-6488-44b8-a2aa-2c01252bd74e" released by "delete_volume" :: held 0.683s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Created reservations ['33efcc12-8e28-47b1-a1a4-0ab9d35eefec', '66636f26-6fd5-4f71-845b-9ff5e174634d', '8305338d-20a8-427f-8e05-28d22531e080', '052f849c-3e6a-4b44-b073-ca7fa09482bb'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:20 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-881d2587-bc62-4a5d-8c09-12141a06e57d" returned: 0 in 0.251s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Lock "cinder-quobyte-881d2587-bc62-4a5d-8c09-12141a06e57d" released by "delete_volume" :: held 0.697s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:20 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:20 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Created reservations ['a1fe5cf7-391a-4ff1-a21c-42337a9694a7', '5817a5eb-0cc6-4bc3-8094-db3d50421ea9', '25263d52-61dd-459e-8648-a1e17df22730', '19914472-9b11-4385-9e82-3a72ed7dee4c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:20 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:20 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:20 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.266s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:20 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:20 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Deleted volume successfully. Nov 03 20:31:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d6863b5f-ea7a-422a-8e3b-14fe23968430 tempest-CreateVolumesFromSourceVolumeTest-43719786 None] Lock "cinder-d16aa37a-6488-44b8-a2aa-2c01252bd74e-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:21 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.269s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:21 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:21 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Deleted volume successfully. Nov 03 20:31:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e43110a-bffa-4cb8-ac01-a96480250a77 tempest-SnapshotsActionsTest-13460560 None] Lock "cinder-881d2587-bc62-4a5d-8c09-12141a06e57d-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:23 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:23 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:23 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.307s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:31:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:31:26 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Flow 'volume_create_manager' (0c64fc32-b88c-4126-ba19-65e3e7efaf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0bee60-dae1-4e5b-b329-9fe57f00083c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0bee60-dae1-4e5b-b329-9fe57f00083c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b67e73b-d112-46be-b53f-ba9cafb35299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8768db81634845749c22aad003d7769c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:27Z,use_quota=True,user_id='5a891c40b1ec4adfa49ab3e1c2be63ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520c2340-c9bd-4e59-aaed-82703e8f5803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520c2340-c9bd-4e59-aaed-82703e8f5803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e703cf-a3a2-4531-b295-0599b0a1102a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.image.glance [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Creating Keystone auth plugin from conf {{(pid=87342) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e703cf-a3a2-4531-b295-0599b0a1102a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b67e73b-d112-46be-b53f-ba9cafb35299', 'volume_name': 'volume-2b67e73b-d112-46be-b53f-ba9cafb35299', 'volume_size': 1, 'image_id': '77b3f83f-5acd-4895-8271-8c7e19e78191', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b3f83f-5acd-4895-8271-8c7e19e78191', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa59192cf04e9bfdf00514368bc3c8d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8768db81634845749c22aad003d7769c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0796b6c7e4d2cc2b97851dd2f9baf9d4d1fd9e7d8a2617dff81a770247536378c89cd2ab23e4d1f8c90d922dc10b7aa27dea088d4799c4b32d7eabe5e4deddd', 'id': '77b3f83f-5acd-4895-8271-8c7e19e78191', 'created_at': datetime.datetime(2026, 11, 3, 19, 31, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 31, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b3f83f-5acd-4895-8271-8c7e19e78191/file', 'properties': {}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407e714c-5b39-4359-9831-5e755097de9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407e714c-5b39-4359-9831-5e755097de9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4cbb86d-9b3d-4c04-98ad-9bc632f27f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:27 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Volume 2b67e73b-d112-46be-b53f-ba9cafb35299: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b67e73b-d112-46be-b53f-ba9cafb35299', 'volume_size': 1, 'image_id': '77b3f83f-5acd-4895-8271-8c7e19e78191', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b3f83f-5acd-4895-8271-8c7e19e78191', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa59192cf04e9bfdf00514368bc3c8d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8768db81634845749c22aad003d7769c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0796b6c7e4d2cc2b97851dd2f9baf9d4d1fd9e7d8a2617dff81a770247536378c89cd2ab23e4d1f8c90d922dc10b7aa27dea088d4799c4b32d7eabe5e4deddd', 'id': '77b3f83f-5acd-4895-8271-8c7e19e78191', 'created_at': datetime.datetime(2026, 11, 3, 19, 31, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 31, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b3f83f-5acd-4895-8271-8c7e19e78191/file', 'properties': {}}, 'image_service': } Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Trying to clone 2b67e73b-d112-46be-b53f-ba9cafb35299 from image 77b3f83f-5acd-4895-8271-8c7e19e78191 at location (None, [{'url': 'file:///opt/stack/data/glance/images/77b3f83f-5acd-4895-8271-8c7e19e78191', 'metadata': {}}]). {{(pid=87342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:31:27 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Image download 0.00 MB at 0.00 MB/s Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9352cf8b-2968-4ff6-b05b-9c00e8fe6af7]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:27 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD Nov 03 20:31:27 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:27 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:27 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD Nov 03 20:31:27 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:28 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD" returned: 1 in 0.328s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Temporary image 77b3f83f-5acd-4895-8271-8c7e19e78191 is fetched for user 5a891c40b1ec4adfa49ab3e1c2be63ab. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92a0a64-d982-40da-8de6-31425d278b20]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:28 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD Nov 03 20:31:28 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:28 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:28 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD Nov 03 20:31:28 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:28 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b67e73b-d112-46be-b53f-ba9cafb35299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8768db81634845749c22aad003d7769c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:27Z,use_quota=True,user_id='5a891c40b1ec4adfa49ab3e1c2be63ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Creating volume 2b67e73b-d112-46be-b53f-ba9cafb35299 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:28 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:31:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:28 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 1073741824 Nov 03 20:31:28 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:29 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 1073741824" returned: 0 in 0.401s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:29 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 Nov 03 20:31:29 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:29 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299" returned: 0 in 0.235s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:29 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Attempting download of 77b3f83f-5acd-4895-8271-8c7e19e78191 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b3f83f-5acd-4895-8271-8c7e19e78191', 'metadata': {}}])) to volume 2b67e73b-d112-46be-b53f-ba9cafb35299. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:31:29 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ac5f63-7bb8-4715-8a79-ba045390c7e9]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b3f83f-5acd-4895-8271-8c7e19e78191_qfp6syxn {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:29 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b3f83f-5acd-4895-8271-8c7e19e78191_qfp6syxn Nov 03 20:31:29 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:29 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b3f83f-5acd-4895-8271-8c7e19e78191_qfp6syxn" returned: 0 in 0.321s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b3f83f-5acd-4895-8271-8c7e19e78191_qfp6syxn {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:30 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b3f83f-5acd-4895-8271-8c7e19e78191_qfp6syxn Nov 03 20:31:30 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:30 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b3f83f-5acd-4895-8271-8c7e19e78191_qfp6syxn" returned: 1 in 0.333s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b3f83f-5acd-4895-8271-8c7e19e78191_qfp6syxn' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:31:30 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4280a8-4d62-4395-96ec-d790c8b4a09f]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:30 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD Nov 03 20:31:30 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:30 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:30 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD Nov 03 20:31:30 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:30 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:31:30 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] 77b3f83f-5acd-4895-8271-8c7e19e78191 was raw, converting to qcow2 {{(pid=87342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:31:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:31 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 Nov 03 20:31:31 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:31 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299" returned: 0 in 0.443s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77b3f83f-5acd-4895-8271-8c7e19e78191_6g_w57zhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:31:31 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:31 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 1G Nov 03 20:31:31 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:31 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 1G" returned: 0 in 0.325s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Downloaded image 77b3f83f-5acd-4895-8271-8c7e19e78191 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b3f83f-5acd-4895-8271-8c7e19e78191', 'metadata': {}}])) to volume 2b67e73b-d112-46be-b53f-ba9cafb35299 successfully. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Temporary image 77b3f83f-5acd-4895-8271-8c7e19e78191 for user 5a891c40b1ec4adfa49ab3e1c2be63ab is deleted. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Marking volume 2b67e73b-d112-46be-b53f-ba9cafb35299 as bootable. {{(pid=87342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Copying metadata from image 77b3f83f-5acd-4895-8271-8c7e19e78191 to 2b67e73b-d112-46be-b53f-ba9cafb35299. {{(pid=87342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Creating volume glance metadata for volume 2b67e73b-d112-46be-b53f-ba9cafb35299 backed by image 77b3f83f-5acd-4895-8271-8c7e19e78191 with: {'image_id': '77b3f83f-5acd-4895-8271-8c7e19e78191', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fa59192cf04e9bfdf00514368bc3c8d5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4cbb86d-9b3d-4c04-98ad-9bc632f27f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b67e73b-d112-46be-b53f-ba9cafb35299', 'volume_size': 1, 'image_id': '77b3f83f-5acd-4895-8271-8c7e19e78191', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b3f83f-5acd-4895-8271-8c7e19e78191', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa59192cf04e9bfdf00514368bc3c8d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8768db81634845749c22aad003d7769c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0796b6c7e4d2cc2b97851dd2f9baf9d4d1fd9e7d8a2617dff81a770247536378c89cd2ab23e4d1f8c90d922dc10b7aa27dea088d4799c4b32d7eabe5e4deddd', 'id': '77b3f83f-5acd-4895-8271-8c7e19e78191', 'created_at': datetime.datetime(2026, 11, 3, 19, 31, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 31, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b3f83f-5acd-4895-8271-8c7e19e78191/file', 'properties': {}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026113ba-b385-4fdb-a714-031ff21039a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:31 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Volume volume-2b67e73b-d112-46be-b53f-ba9cafb35299 (2b67e73b-d112-46be-b53f-ba9cafb35299): created successfully Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026113ba-b385-4fdb-a714-031ff21039a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Flow 'volume_create_manager' (0c64fc32-b88c-4126-ba19-65e3e7efaf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:31 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b4ae21bd-e528-483e-b6b1-ff7117160113 tempest-VolumeImageDependencyTests-1026699541 None] Created volume successfully. Nov 03 20:31:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Acquiring lock "cinder-2b67e73b-d112-46be-b53f-ba9cafb35299-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Lock "cinder-2b67e73b-d112-46be-b53f-ba9cafb35299-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Acquiring lock "cinder-quobyte-2b67e73b-d112-46be-b53f-ba9cafb35299" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Lock "cinder-quobyte-2b67e73b-d112-46be-b53f-ba9cafb35299" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:32 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6abe2c-f703-477a-877e-1fc1df246092]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:32 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 Nov 03 20:31:32 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:32 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299" returned: 0 in 0.369s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:32 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299 Nov 03 20:31:32 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:32 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2b67e73b-d112-46be-b53f-ba9cafb35299" returned: 0 in 0.253s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Lock "cinder-quobyte-2b67e73b-d112-46be-b53f-ba9cafb35299" released by "delete_volume" :: held 0.663s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:33 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Created reservations ['c6d21ce1-8fee-4c37-9efd-3f8d515a7ae6', '9ff95953-6d8b-47aa-bd9a-c15bc9927df7', '32fbf21e-fff1-4804-822f-903ce1547b0a', '25ccc078-8546-41a0-8f13-1fff43540829'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:33 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:33 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:33 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:33 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:33 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Deleted volume successfully. Nov 03 20:31:33 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-61515b70-b664-4d00-85e9-c16226504c14 tempest-VolumeImageDependencyTests-1026699541 None] Lock "cinder-2b67e73b-d112-46be-b53f-ba9cafb35299-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Flow 'volume_create_manager' (50717bd3-c94c-40ea-8018-8196cd006712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ea19a7-f2e0-4192-8833-9114ddb91400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ea19a7-f2e0-4192-8833-9114ddb91400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-487108636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980ee16f-ffbb-450d-bc74-7030a18d2cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19be22d9e1324f199da37c51f442c5c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:37Z,use_quota=True,user_id='37c653e955824e6aab9183870a617499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1ef05d-8847-4fbe-bdee-9bac14976040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1ef05d-8847-4fbe-bdee-9bac14976040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec216b24-d1b4-4d80-83bc-f2f23fd3bfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec216b24-d1b4-4d80-83bc-f2f23fd3bfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980ee16f-ffbb-450d-bc74-7030a18d2cac', 'volume_name': 'volume-980ee16f-ffbb-450d-bc74-7030a18d2cac', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b21af1-06d0-412f-9f69-7c191246bed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b21af1-06d0-412f-9f69-7c191246bed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d3edd6-2ced-4281-a8c8-000c93f56d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:37 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Volume 980ee16f-ffbb-450d-bc74-7030a18d2cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980ee16f-ffbb-450d-bc74-7030a18d2cac', 'volume_size': 1} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-487108636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980ee16f-ffbb-450d-bc74-7030a18d2cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19be22d9e1324f199da37c51f442c5c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:37Z,use_quota=True,user_id='37c653e955824e6aab9183870a617499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Creating volume 980ee16f-ffbb-450d-bc74-7030a18d2cac {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:37 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:37 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac 1073741824 Nov 03 20:31:37 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Flow 'volume_create_manager' (1b25ccfe-1bc3-400e-bdc8-f11908ef513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790f4142-b509-4321-ad6c-e249954535cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790f4142-b509-4321-ad6c-e249954535cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1479651539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433fa438-694a-48a3-b0e9-d62e6222d5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639c4650115c4ba394284aca26c73840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:38Z,use_quota=True,user_id='391c8ec858ce4de9a7c2468355f6193f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dff6db-834c-4646-826c-5e3c7a3a2baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dff6db-834c-4646-826c-5e3c7a3a2baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff46ee7-a5ae-4235-b271-376f3b5ea983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff46ee7-a5ae-4235-b271-376f3b5ea983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '433fa438-694a-48a3-b0e9-d62e6222d5b2', 'volume_name': 'volume-433fa438-694a-48a3-b0e9-d62e6222d5b2', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be33efd4-47f4-456f-8711-2a9a3f013753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be33efd4-47f4-456f-8711-2a9a3f013753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f44654-dd46-419f-a680-2c48f4bcb73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:37 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Volume 433fa438-694a-48a3-b0e9-d62e6222d5b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-433fa438-694a-48a3-b0e9-d62e6222d5b2', 'volume_size': 1} Nov 03 20:31:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:38 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac 1073741824" returned: 0 in 0.388s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:38 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac Nov 03 20:31:38 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:38 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac" returned: 0 in 0.230s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.545s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1479651539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433fa438-694a-48a3-b0e9-d62e6222d5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639c4650115c4ba394284aca26c73840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:38Z,use_quota=True,user_id='391c8ec858ce4de9a7c2468355f6193f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Creating volume 433fa438-694a-48a3-b0e9-d62e6222d5b2 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:38 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d3edd6-2ced-4281-a8c8-000c93f56d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980ee16f-ffbb-450d-bc74-7030a18d2cac', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816dfb9a-2f7b-4694-b9cc-604aca54362c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:38 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2 1073741824 Nov 03 20:31:38 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:38 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Volume volume-980ee16f-ffbb-450d-bc74-7030a18d2cac (980ee16f-ffbb-450d-bc74-7030a18d2cac): created successfully Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816dfb9a-2f7b-4694-b9cc-604aca54362c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Flow 'volume_create_manager' (50717bd3-c94c-40ea-8018-8196cd006712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:38 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-45d3d7ab-f9f0-4170-bef5-d085508ef671 tempest-ProjectReaderTests-2100757498 None] Created volume successfully. Nov 03 20:31:38 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2 1073741824" returned: 0 in 0.399s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:38 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2 Nov 03 20:31:38 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:39 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2" returned: 0 in 0.231s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f44654-dd46-419f-a680-2c48f4bcb73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433fa438-694a-48a3-b0e9-d62e6222d5b2', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002499fb-508c-4602-9b5a-144ddc42f07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:39 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Volume volume-433fa438-694a-48a3-b0e9-d62e6222d5b2 (433fa438-694a-48a3-b0e9-d62e6222d5b2): created successfully Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002499fb-508c-4602-9b5a-144ddc42f07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Flow 'volume_create_manager' (1b25ccfe-1bc3-400e-bdc8-f11908ef513f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-abca71aa-5d7f-46a8-9ce5-e4bc1e3f159d tempest-VolumeQuotasAdminTestJSON-1189576922 None] Created volume successfully. Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Acquiring lock "cinder-433fa438-694a-48a3-b0e9-d62e6222d5b2-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "cinder-433fa438-694a-48a3-b0e9-d62e6222d5b2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Acquiring lock "cinder-quobyte-433fa438-694a-48a3-b0e9-d62e6222d5b2" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "cinder-quobyte-433fa438-694a-48a3-b0e9-d62e6222d5b2" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Acquiring lock "cinder-980ee16f-ffbb-450d-bc74-7030a18d2cac-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de33157-6895-4a1b-9ad8-7eff62996a69]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Lock "cinder-980ee16f-ffbb-450d-bc74-7030a18d2cac-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Acquiring lock "cinder-quobyte-980ee16f-ffbb-450d-bc74-7030a18d2cac" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Lock "cinder-quobyte-980ee16f-ffbb-450d-bc74-7030a18d2cac" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21fb004-68c1-4a4b-8928-40d1fecb431f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:39 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2 Nov 03 20:31:39 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:39 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac Nov 03 20:31:39 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:39 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2" returned: 0 in 0.373s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:39 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2 Nov 03 20:31:39 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:40 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac" returned: 0 in 0.387s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:40 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac Nov 03 20:31:40 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:40 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-433fa438-694a-48a3-b0e9-d62e6222d5b2" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "cinder-quobyte-433fa438-694a-48a3-b0e9-d62e6222d5b2" released by "delete_volume" :: held 0.686s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=225,cinder:SELECT=180,cinder:INSERT=54,cinder:DELETE=18 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Created reservations ['0b4fc33a-b903-4593-824e-892f982f03d7', '967487eb-a33d-4bc3-b3ff-cdc7db6c2ae1', '26b14123-b8d4-4c5f-a511-eca39cc8cf8d', 'ad553263-cdcd-4cd1-98eb-fe6ff119d56d'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:40 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-980ee16f-ffbb-450d-bc74-7030a18d2cac" returned: 0 in 0.262s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Lock "cinder-quobyte-980ee16f-ffbb-450d-bc74-7030a18d2cac" released by "delete_volume" :: held 0.699s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:40 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:40 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Created reservations ['9d931636-b9b8-4d12-958f-f47edc259c4e', 'f31b38f1-6670-4ea7-a7ae-480bfbdd9618', '5aa4c711-6a2b-4a88-9457-48508570a27f', '83b2d1ce-8e9e-4003-b3e7-8385a587278c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:40 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:40 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:40 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.270s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Deleted volume successfully. Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bd4851cd-90a8-4623-b96b-e09286abdd25 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "cinder-433fa438-694a-48a3-b0e9-d62e6222d5b2-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:40 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.269s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Deleted volume successfully. Nov 03 20:31:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-570323c6-7905-4cbe-b79d-16bed52dc64c tempest-ProjectReaderTests-2100757498 None] Lock "cinder-980ee16f-ffbb-450d-bc74-7030a18d2cac-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Flow 'volume_create_manager' (262f0cd1-3afa-4324-b1d2-ebcc95b6f723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bba0424-3666-41b2-b0fc-675d4f838010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bba0424-3666-41b2-b0fc-675d4f838010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1273543578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392c6344-3e74-4359-88c3-ef8f65e8a60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639c4650115c4ba394284aca26c73840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:41Z,use_quota=True,user_id='391c8ec858ce4de9a7c2468355f6193f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35894547-67bb-4988-9ea8-409dfd80d369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35894547-67bb-4988-9ea8-409dfd80d369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e205a9-6282-4c00-b7e0-9fc064538d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e205a9-6282-4c00-b7e0-9fc064538d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392c6344-3e74-4359-88c3-ef8f65e8a60a', 'volume_name': 'volume-392c6344-3e74-4359-88c3-ef8f65e8a60a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141ea53d-e257-4e5f-8520-77c569fd297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141ea53d-e257-4e5f-8520-77c569fd297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a052df-f0a7-4bec-a265-460b2203b1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:41 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Volume 392c6344-3e74-4359-88c3-ef8f65e8a60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392c6344-3e74-4359-88c3-ef8f65e8a60a', 'volume_size': 1} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1273543578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392c6344-3e74-4359-88c3-ef8f65e8a60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639c4650115c4ba394284aca26c73840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:41Z,use_quota=True,user_id='391c8ec858ce4de9a7c2468355f6193f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Creating volume 392c6344-3e74-4359-88c3-ef8f65e8a60a {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:41 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:41 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a 1073741824 Nov 03 20:31:41 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Flow 'volume_create_manager' (c96f71b4-c6c1-46d6-913d-74d9c6f9be45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e4f491-042d-44de-94a1-b2eddde55414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e4f491-042d-44de-94a1-b2eddde55414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1459098683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19be22d9e1324f199da37c51f442c5c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:41Z,use_quota=True,user_id='37c653e955824e6aab9183870a617499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bea1141-4e4b-4942-b36b-d3c3bcb07afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bea1141-4e4b-4942-b36b-d3c3bcb07afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669fd4b4-4c55-4b51-9b96-50aa2f41ee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669fd4b4-4c55-4b51-9b96-50aa2f41ee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6', 'volume_name': 'volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90bc83a0-58b3-44cd-b9c0-90d79a3109bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90bc83a0-58b3-44cd-b9c0-90d79a3109bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7086ad-817d-405c-a134-e9e60499df22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:41 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Volume 53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6', 'volume_size': 1} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:41 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a 1073741824" returned: 0 in 0.427s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:41 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a Nov 03 20:31:41 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:42 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1459098683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19be22d9e1324f199da37c51f442c5c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:41Z,use_quota=True,user_id='37c653e955824e6aab9183870a617499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Creating volume 53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:42 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a052df-f0a7-4bec-a265-460b2203b1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392c6344-3e74-4359-88c3-ef8f65e8a60a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:42 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6 1073741824 Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b4a66a-7d11-4f33-950a-eca447e4f7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:42 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:42 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Volume volume-392c6344-3e74-4359-88c3-ef8f65e8a60a (392c6344-3e74-4359-88c3-ef8f65e8a60a): created successfully Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b4a66a-7d11-4f33-950a-eca447e4f7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Flow 'volume_create_manager' (262f0cd1-3afa-4324-b1d2-ebcc95b6f723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-979b586c-b0e8-42d3-a8f8-4ef04c2615f4 tempest-VolumeQuotasAdminTestJSON-1189576922 None] Created volume successfully. Nov 03 20:31:42 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6 1073741824" returned: 0 in 0.401s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:42 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6 Nov 03 20:31:42 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:42 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6" returned: 0 in 0.230s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7086ad-817d-405c-a134-e9e60499df22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20031514-579b-4da0-a25a-ae530e48237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:42 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Volume volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6 (53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6): created successfully Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20031514-579b-4da0-a25a-ae530e48237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Flow 'volume_create_manager' (c96f71b4-c6c1-46d6-913d-74d9c6f9be45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-581abcea-9293-4307-a1d3-05a88e37c9c2 tempest-ProjectReaderTests-2100757498 None] Created volume successfully. Nov 03 20:31:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Acquiring lock "cinder-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Lock "cinder-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Acquiring lock "cinder-quobyte-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Lock "cinder-quobyte-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:43 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2a2080-6fbd-4c1c-af2d-7a0072ea0241]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:43 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6 Nov 03 20:31:43 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:43 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6" returned: 0 in 0.376s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:43 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6 Nov 03 20:31:43 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:43 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d61fc0fc-9b3f-42a8-ba30-3a6d819987d0 tempest-VolumeQuotasAdminTestJSON-1503890299 None] Transfer volume completed successfully. Nov 03 20:31:44 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6" returned: 0 in 0.259s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Lock "cinder-quobyte-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6" released by "delete_volume" :: held 0.679s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Created reservations ['379add28-3864-4000-8eac-4e5f60c1d11b', 'da1e6d07-9fc2-4802-b01b-1a1e191b7413', '6e8562bb-f993-42cb-b0db-14d49879953d', '7fcf2897-75de-4e4a-8a33-4137f0e0b2ee'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:44 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:44 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Acquiring lock "cinder-392c6344-3e74-4359-88c3-ef8f65e8a60a-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Lock "cinder-392c6344-3e74-4359-88c3-ef8f65e8a60a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Acquiring lock "cinder-quobyte-392c6344-3e74-4359-88c3-ef8f65e8a60a" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Lock "cinder-quobyte-392c6344-3e74-4359-88c3-ef8f65e8a60a" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b65093e-81b3-459b-9428-ef11705ac429]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:44 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.291s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Deleted volume successfully. Nov 03 20:31:44 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a Nov 03 20:31:44 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c9bf0434-889b-4014-b41d-099806aa6e9b tempest-ProjectReaderTests-2100757498 None] Lock "cinder-53a1901d-5cea-40fd-aaf1-9b9d4e9d84e6-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:44 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a" returned: 0 in 0.385s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:44 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a Nov 03 20:31:44 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:45 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-392c6344-3e74-4359-88c3-ef8f65e8a60a" returned: 0 in 0.268s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Lock "cinder-quobyte-392c6344-3e74-4359-88c3-ef8f65e8a60a" released by "delete_volume" :: held 0.703s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Created reservations ['06ed1a0e-c258-45ab-b3f4-4ba5e1433f61', '0a20451c-56cb-44bc-ac1b-2f136c9c060c', '0b41c44d-147e-49df-8af9-1762b1700ae0', 'e3e7b67a-64b5-4f86-a0a3-dc65c21ac66f'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:45 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:31:45 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:45 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.244s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Deleted volume successfully. Nov 03 20:31:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b6905d05-4e8b-43c2-9fd8-01404598717b tempest-VolumeQuotasAdminTestJSON-2036300032 None] Lock "cinder-392c6344-3e74-4359-88c3-ef8f65e8a60a-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:55 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=154,cinder:INSERT=61,cinder:UPDATE=221,cinder:DELETE=17 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:31:55 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=36,cinder:SELECT=21,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Flow 'volume_create_manager' (ec5c453c-d946-4619-ae2e-c5c017c3f49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc2340b-cd4f-486b-8d93-78fcf0a433c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc2340b-cd4f-486b-8d93-78fcf0a433c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-828327652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc4e218-0fa4-4605-a00d-d3cc27b1742f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30940ae08a7435695e987b2edc697bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:07Z,use_quota=True,user_id='88649f775f1a4023b47ca178767da138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844e5a1a-bf3b-49f6-86b1-82e7e1d0cd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844e5a1a-bf3b-49f6-86b1-82e7e1d0cd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348fc412-9b18-4d07-befe-c6e989f2dca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348fc412-9b18-4d07-befe-c6e989f2dca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc4e218-0fa4-4605-a00d-d3cc27b1742f', 'volume_name': 'volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bfa35f-72c0-4c9e-a402-e74308109d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bfa35f-72c0-4c9e-a402-e74308109d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5390014-0406-42ee-9976-1fc1c034e936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:07 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Volume adc4e218-0fa4-4605-a00d-d3cc27b1742f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f', 'volume_size': 1} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-828327652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc4e218-0fa4-4605-a00d-d3cc27b1742f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30940ae08a7435695e987b2edc697bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:07Z,use_quota=True,user_id='88649f775f1a4023b47ca178767da138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Creating volume adc4e218-0fa4-4605-a00d-d3cc27b1742f {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:07 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:07 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f 1073741824 Nov 03 20:32:07 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:07 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f 1073741824" returned: 0 in 0.391s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:08 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f Nov 03 20:32:08 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:08 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f" returned: 0 in 0.236s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5390014-0406-42ee-9976-1fc1c034e936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221a6500-6ae7-4272-b329-0cbbdb440d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:08 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Volume volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f (adc4e218-0fa4-4605-a00d-d3cc27b1742f): created successfully Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221a6500-6ae7-4272-b329-0cbbdb440d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Flow 'volume_create_manager' (ec5c453c-d946-4619-ae2e-c5c017c3f49f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:08 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-dce86a5d-eb05-4c7a-a325-c02cf40e3465 tempest-VolumesListAdminTestJSON-1862587168 None] Created volume successfully. Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Flow 'volume_create_manager' (a05fa0a4-3706-41ea-b0f3-67ebaa0f812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4955166-8b03-4135-b110-e9248113f3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4955166-8b03-4135-b110-e9248113f3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-61015296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da51ccd-4283-4453-8627-a0a9e273ee84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30940ae08a7435695e987b2edc697bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:09Z,use_quota=True,user_id='88649f775f1a4023b47ca178767da138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab52240-097d-446d-9943-17ddd1bd9031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab52240-097d-446d-9943-17ddd1bd9031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d10afa5-d919-46c9-b323-6c197878f474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d10afa5-d919-46c9-b323-6c197878f474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da51ccd-4283-4453-8627-a0a9e273ee84', 'volume_name': 'volume-6da51ccd-4283-4453-8627-a0a9e273ee84', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34fcec2-de50-4d7e-aed0-69a3d0c7c76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34fcec2-de50-4d7e-aed0-69a3d0c7c76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (916398b6-7a39-4240-8be2-825cd88ca844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:09 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Volume 6da51ccd-4283-4453-8627-a0a9e273ee84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da51ccd-4283-4453-8627-a0a9e273ee84', 'volume_size': 1} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-61015296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da51ccd-4283-4453-8627-a0a9e273ee84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30940ae08a7435695e987b2edc697bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:09Z,use_quota=True,user_id='88649f775f1a4023b47ca178767da138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Creating volume 6da51ccd-4283-4453-8627-a0a9e273ee84 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:09 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:09 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84 1073741824 Nov 03 20:32:09 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:09 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84 1073741824" returned: 0 in 0.378s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:09 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84 Nov 03 20:32:09 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:09 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84" returned: 0 in 0.234s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] <== create_volume: return (650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (916398b6-7a39-4240-8be2-825cd88ca844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da51ccd-4283-4453-8627-a0a9e273ee84', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1411ac60-b233-4d24-96e3-38c2ed67f000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:09 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Volume volume-6da51ccd-4283-4453-8627-a0a9e273ee84 (6da51ccd-4283-4453-8627-a0a9e273ee84): created successfully Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1411ac60-b233-4d24-96e3-38c2ed67f000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Flow 'volume_create_manager' (a05fa0a4-3706-41ea-b0f3-67ebaa0f812b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:09 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-58fae415-0c9f-43fe-956c-9ec310032e8c tempest-VolumesListAdminTestJSON-1862587168 None] Created volume successfully. Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Flow 'volume_create_manager' (dfcffb72-31b9-4c8d-b6ea-95ecf9620fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98c64f9-96bf-43a5-b0e2-fc7256ba6f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98c64f9-96bf-43a5-b0e2-fc7256ba6f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-129030177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30940ae08a7435695e987b2edc697bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:10Z,use_quota=True,user_id='88649f775f1a4023b47ca178767da138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fcb7839-e2d0-4566-b22e-f38df9c491e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fcb7839-e2d0-4566-b22e-f38df9c491e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ae6247-0359-4f6b-ac2c-4190c0497d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ae6247-0359-4f6b-ac2c-4190c0497d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2', 'volume_name': 'volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28b5a00-6fe1-4f99-8b19-97617af9b30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28b5a00-6fe1-4f99-8b19-97617af9b30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a634f3-bb12-43b1-81b4-2c94687d60dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:10 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Volume 4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2', 'volume_size': 1} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-129030177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30940ae08a7435695e987b2edc697bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:10Z,use_quota=True,user_id='88649f775f1a4023b47ca178767da138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Creating volume 4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:10 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:10 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2 1073741824 Nov 03 20:32:10 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:10 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2 1073741824" returned: 0 in 0.385s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:10 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2 Nov 03 20:32:10 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:11 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2" returned: 0 in 0.231s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] <== create_volume: return (652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.655s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a634f3-bb12-43b1-81b4-2c94687d60dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aadf1e1-5905-4a2d-8436-4067ea01bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:11 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Volume volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2 (4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2): created successfully Nov 03 20:32:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aadf1e1-5905-4a2d-8436-4067ea01bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Flow 'volume_create_manager' (dfcffb72-31b9-4c8d-b6ea-95ecf9620fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:11 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ec765d1f-592a-41e0-800d-6e4b7daeeec6 tempest-VolumesListAdminTestJSON-1862587168 None] Created volume successfully. Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Flow 'volume_create_manager' (ceb1eeb1-ec94-4d14-8f23-0c824dd731cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23aab0f-9818-4bcb-92de-3a053e65b491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23aab0f-9818-4bcb-92de-3a053e65b491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70e9179-0f79-4f9d-980a-985921de7b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d51134b2484d4bab48081653cb3337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:12Z,use_quota=True,user_id='afa5096b7b564a5bb5d4e836521a7610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6507e6c1-9c68-4c5f-bb16-ae898a398e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6507e6c1-9c68-4c5f-bb16-ae898a398e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe159275-9274-46d8-a7f6-e9db0b7e4dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe159275-9274-46d8-a7f6-e9db0b7e4dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70e9179-0f79-4f9d-980a-985921de7b5f', 'volume_name': 'volume-f70e9179-0f79-4f9d-980a-985921de7b5f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb0f5d3-43da-4720-b50e-df9a8c9b9f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb0f5d3-43da-4720-b50e-df9a8c9b9f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08345a17-9efc-46e4-8cdd-a0a96e5260c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:12 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Volume f70e9179-0f79-4f9d-980a-985921de7b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70e9179-0f79-4f9d-980a-985921de7b5f', 'volume_size': 1} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70e9179-0f79-4f9d-980a-985921de7b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d51134b2484d4bab48081653cb3337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:12Z,use_quota=True,user_id='afa5096b7b564a5bb5d4e836521a7610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Creating volume f70e9179-0f79-4f9d-980a-985921de7b5f {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:12 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:12 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f 1073741824 Nov 03 20:32:12 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:12 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f 1073741824" returned: 0 in 0.375s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:12 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f Nov 03 20:32:12 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:12 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f" returned: 0 in 0.236s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] <== create_volume: return (646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.648s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08345a17-9efc-46e4-8cdd-a0a96e5260c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70e9179-0f79-4f9d-980a-985921de7b5f', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba7e0ae-c143-482f-a6ca-51400f90a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:12 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Volume volume-f70e9179-0f79-4f9d-980a-985921de7b5f (f70e9179-0f79-4f9d-980a-985921de7b5f): created successfully Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba7e0ae-c143-482f-a6ca-51400f90a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Flow 'volume_create_manager' (ceb1eeb1-ec94-4d14-8f23-0c824dd731cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:12 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-50d5719a-726e-49cc-8dac-6250fa73a2cf tempest-VolumesListAdminTestJSON-423219765 None] Created volume successfully. Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Acquiring lock "cinder-f70e9179-0f79-4f9d-980a-985921de7b5f-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Lock "cinder-f70e9179-0f79-4f9d-980a-985921de7b5f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Acquiring lock "cinder-quobyte-f70e9179-0f79-4f9d-980a-985921de7b5f" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Lock "cinder-quobyte-f70e9179-0f79-4f9d-980a-985921de7b5f" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2613c0dc-02e9-491e-84d0-4067a865564a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "cinder-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "cinder-quobyte-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-quobyte-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:13 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f Nov 03 20:32:13 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0de7cd-6983-42f3-b6b2-0c603dd2cc0a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:13 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2 Nov 03 20:32:13 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:13 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f" returned: 0 in 0.380s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:13 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f Nov 03 20:32:13 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:13 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2" returned: 0 in 0.366s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:13 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2 Nov 03 20:32:13 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:13 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f70e9179-0f79-4f9d-980a-985921de7b5f" returned: 0 in 0.257s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Lock "cinder-quobyte-f70e9179-0f79-4f9d-980a-985921de7b5f" released by "delete_volume" :: held 0.685s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Created reservations ['02d08dd0-934c-4dd0-a703-99393bf65da5', '34252186-12bb-4d24-8c31-f9b5421756b5', '9362b52b-1a81-4eea-9330-a56a9e6ea631', 'a1b1fc12-c21d-4edb-ab7d-5c9bef369cd3'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:13 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2" returned: 0 in 0.262s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:14 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:32:14 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-quobyte-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2" released by "delete_volume" :: held 0.676s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Created reservations ['b9976328-61df-4ddd-ae7f-0b8f530dca9f', 'd38a55c1-ed94-4240-859c-64e27a9858e9', '6b909fcf-c410-4277-b767-41a8de1c6fec', 'e425d33f-f173-499d-a5f8-06c0b2e6032c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:14 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:32:14 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:14 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:14 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Deleted volume successfully. Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d2ffdc4e-af49-406c-bd6b-ca0af8c27cda tempest-VolumesListAdminTestJSON-423219765 None] Lock "cinder-f70e9179-0f79-4f9d-980a-985921de7b5f-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:14 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:14 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Deleted volume successfully. Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0bd01432-ccbf-475f-8948-4d3d2a6d2104 tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-4bbaf7d9-8e26-4150-b9e3-2dd7c3623bc2-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "cinder-6da51ccd-4283-4453-8627-a0a9e273ee84-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-6da51ccd-4283-4453-8627-a0a9e273ee84-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "cinder-quobyte-6da51ccd-4283-4453-8627-a0a9e273ee84" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-quobyte-6da51ccd-4283-4453-8627-a0a9e273ee84" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aee314-d0af-453d-ad11-6bee1b9cd42a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:14 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84 Nov 03 20:32:14 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:14 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84" returned: 0 in 0.346s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:14 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84 Nov 03 20:32:14 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:15 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-6da51ccd-4283-4453-8627-a0a9e273ee84" returned: 0 in 0.232s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-quobyte-6da51ccd-4283-4453-8627-a0a9e273ee84" released by "delete_volume" :: held 0.624s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Created reservations ['8d052b65-9daf-48ce-8ea2-4c3b6d25e566', 'f1e3cf74-9783-47f6-a343-f5051a795f55', '9a0dca03-5d7a-4649-bd78-c4d6caea44cc', 'dde7c7aa-6096-485b-a786-aa52f1cfe512'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:15 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:32:15 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:15 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.231s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:15 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Deleted volume successfully. Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e3e4afba-47e9-4548-89fb-df28786beb7b tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-6da51ccd-4283-4453-8627-a0a9e273ee84-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "cinder-adc4e218-0fa4-4605-a00d-d3cc27b1742f-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-adc4e218-0fa4-4605-a00d-d3cc27b1742f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "cinder-quobyte-adc4e218-0fa4-4605-a00d-d3cc27b1742f" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-quobyte-adc4e218-0fa4-4605-a00d-d3cc27b1742f" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccecf8d6-3de7-40a5-b6d7-75563a15c786]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:15 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f Nov 03 20:32:15 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:16 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f" returned: 0 in 0.348s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:16 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f Nov 03 20:32:16 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:16 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-adc4e218-0fa4-4605-a00d-d3cc27b1742f" returned: 0 in 0.231s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-quobyte-adc4e218-0fa4-4605-a00d-d3cc27b1742f" released by "delete_volume" :: held 0.617s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Created reservations ['81b0e4d6-3173-4b5d-91a7-4499f1a45a76', '943c7773-a78c-4465-b085-eb45dea8cc2a', '810f8b29-b8fb-4f1b-8e67-2e3ee27880bb', '82df84d4-6d3e-452b-b51c-a5e61ca2b32d'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:16 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:32:16 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:16 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.236s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:16 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Deleted volume successfully. Nov 03 20:32:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dd2bada4-de0c-4f10-b463-d2782b96918f tempest-VolumesListAdminTestJSON-1862587168 None] Lock "cinder-adc4e218-0fa4-4605-a00d-d3cc27b1742f-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:21 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Flow 'volume_create_manager' (3820dc78-870f-4c4c-b860-c18b68c17904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96cd63a-bf14-429f-8c43-d62e0a21ccfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96cd63a-bf14-429f-8c43-d62e0a21ccfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-812671472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72367c2-10fb-4455-b937-aa0bcd09052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebedd1606b124b4c9553698e2070b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:22Z,use_quota=True,user_id='5b583fe1208140deb1a3490fccdd6e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42655159-801f-45ef-b3b5-a2ed1c06bc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42655159-801f-45ef-b3b5-a2ed1c06bc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c308fd-f83d-4b84-8ee1-ff3f1d46d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c308fd-f83d-4b84-8ee1-ff3f1d46d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a72367c2-10fb-4455-b937-aa0bcd09052b', 'volume_name': 'volume-a72367c2-10fb-4455-b937-aa0bcd09052b', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42edada7-0d6f-4a72-a39f-a975856fd344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42edada7-0d6f-4a72-a39f-a975856fd344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0150f964-1f61-4220-a1d2-9ca3767a4846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:21 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Volume a72367c2-10fb-4455-b937-aa0bcd09052b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a72367c2-10fb-4455-b937-aa0bcd09052b', 'volume_size': 1} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-812671472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72367c2-10fb-4455-b937-aa0bcd09052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebedd1606b124b4c9553698e2070b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:22Z,use_quota=True,user_id='5b583fe1208140deb1a3490fccdd6e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Creating volume a72367c2-10fb-4455-b937-aa0bcd09052b {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:22 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:22 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b 1073741824 Nov 03 20:32:22 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:22 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b 1073741824" returned: 0 in 0.391s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:22 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b Nov 03 20:32:22 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:22 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b" returned: 0 in 0.247s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0150f964-1f61-4220-a1d2-9ca3767a4846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a72367c2-10fb-4455-b937-aa0bcd09052b', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fffe0d-3280-4737-90ae-bc714033bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:22 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Volume volume-a72367c2-10fb-4455-b937-aa0bcd09052b (a72367c2-10fb-4455-b937-aa0bcd09052b): created successfully Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fffe0d-3280-4737-90ae-bc714033bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Flow 'volume_create_manager' (3820dc78-870f-4c4c-b860-c18b68c17904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:22 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-527d242c-9ce5-4db9-bcc6-ca5aa7e03636 tempest-AbsoluteLimitsTests-1335810274 None] Created volume successfully. Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Acquiring lock "cinder-a72367c2-10fb-4455-b937-aa0bcd09052b-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Lock "cinder-a72367c2-10fb-4455-b937-aa0bcd09052b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Acquiring lock "cinder-quobyte-a72367c2-10fb-4455-b937-aa0bcd09052b" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Lock "cinder-quobyte-a72367c2-10fb-4455-b937-aa0bcd09052b" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade03868-371c-4353-ad78-04a1a62b64ed]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:23 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b Nov 03 20:32:23 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:23 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b" returned: 0 in 0.362s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:23 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b Nov 03 20:32:23 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:23 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:32:23 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:23 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a72367c2-10fb-4455-b937-aa0bcd09052b" returned: 0 in 0.250s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Lock "cinder-quobyte-a72367c2-10fb-4455-b937-aa0bcd09052b" released by "delete_volume" :: held 0.653s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Created reservations ['68b9abff-a9d8-49a5-adb7-907be7d85dd1', '3efe25ff-877a-4e56-be9b-19e3f3af1147', 'a0d3631d-bce0-469e-b7ee-97d9b0e1cfd0', '0f01d3d7-f1ef-4c38-a1b9-464200098c94'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:23 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.331s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:32:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:32:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:32:24 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:32:24 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:24 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.262s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:24 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Deleted volume successfully. Nov 03 20:32:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-5711d7d7-9499-4625-bc79-4c5dbba365a0 tempest-AbsoluteLimitsTests-1335810274 None] Lock "cinder-a72367c2-10fb-4455-b937-aa0bcd09052b-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Flow 'volume_create_manager' (b0f0ddf7-0aed-4dd4-8159-d1d78097c339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be40315a-2aae-4ef4-9b6e-7093317cf00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be40315a-2aae-4ef4-9b6e-7093317cf00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-845597241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d6d560-3cff-4af2-8e5d-1721ab5f0818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277e52f790054b259fd38683ad2e4f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:29Z,use_quota=True,user_id='9325bc671bf14d4ba1a67962944dc0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd4978d-e9d1-463d-bacc-5b0ca37b1d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd4978d-e9d1-463d-bacc-5b0ca37b1d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0ae99b-e42e-4fec-8fe0-7959a8348c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0ae99b-e42e-4fec-8fe0-7959a8348c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d6d560-3cff-4af2-8e5d-1721ab5f0818', 'volume_name': 'volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97494991-654a-45a0-b143-6614e89d5cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97494991-654a-45a0-b143-6614e89d5cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40e73a1-65cb-4e46-b679-9a6785fd71d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:28 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Volume 94d6d560-3cff-4af2-8e5d-1721ab5f0818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818', 'volume_size': 1} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-845597241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d6d560-3cff-4af2-8e5d-1721ab5f0818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277e52f790054b259fd38683ad2e4f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:29Z,use_quota=True,user_id='9325bc671bf14d4ba1a67962944dc0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Creating volume 94d6d560-3cff-4af2-8e5d-1721ab5f0818 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:28 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:32:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:28 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818 1073741824 Nov 03 20:32:28 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:29 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818 1073741824" returned: 0 in 0.395s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:29 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818 Nov 03 20:32:29 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:29 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818" returned: 0 in 0.244s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40e73a1-65cb-4e46-b679-9a6785fd71d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36026539-638c-45e8-a3a6-cfa3fddfdf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:29 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Volume volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818 (94d6d560-3cff-4af2-8e5d-1721ab5f0818): created successfully Nov 03 20:32:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36026539-638c-45e8-a3a6-cfa3fddfdf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Flow 'volume_create_manager' (b0f0ddf7-0aed-4dd4-8159-d1d78097c339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:29 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-cbdb9f8e-2d38-4f47-822e-0037d8e6ef76 tempest-VolumesMetadataTest-1820746600 None] Created volume successfully. Nov 03 20:32:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Acquiring lock "cinder-94d6d560-3cff-4af2-8e5d-1721ab5f0818-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Lock "cinder-94d6d560-3cff-4af2-8e5d-1721ab5f0818-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Acquiring lock "cinder-quobyte-94d6d560-3cff-4af2-8e5d-1721ab5f0818" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Lock "cinder-quobyte-94d6d560-3cff-4af2-8e5d-1721ab5f0818" acquired by "delete_volume" :: waited 0.012s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:30 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1c9c39-18c3-412d-bea7-3a74c4ec1480]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:30 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818 Nov 03 20:32:30 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:30 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818" returned: 0 in 0.342s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:30 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818 Nov 03 20:32:30 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:30 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-94d6d560-3cff-4af2-8e5d-1721ab5f0818" returned: 0 in 0.244s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Lock "cinder-quobyte-94d6d560-3cff-4af2-8e5d-1721ab5f0818" released by "delete_volume" :: held 0.627s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:30 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Created reservations ['43995832-7321-4e34-8359-27babbf8d16c', '8468ecac-db11-4c5e-96ec-6dd732056ba9', 'a317cd18-579a-4ddb-95bc-51127c7b0eb4', 'b7c7c36b-d2fa-483b-ba26-c91244184de7'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:31 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:32:31 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:31 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.234s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:31 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:31 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Deleted volume successfully. Nov 03 20:32:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dec9f5e5-152f-4d83-b286-eb3c135f24f0 tempest-VolumesMetadataTest-1820746600 None] Lock "cinder-94d6d560-3cff-4af2-8e5d-1721ab5f0818-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Flow 'volume_create_manager' (f6859d80-f881-4908-b4d5-048538e49b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf6cc68-c8cb-4a2d-be64-2ce251983c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf6cc68-c8cb-4a2d-be64-2ce251983c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1981193386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afde7470-7a30-4ea4-aac2-ed46a8334341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90d7d85691e483785423bd68844795b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:34Z,use_quota=True,user_id='5392399c1bc141069ba3a49c3d229576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5154dec7-b231-4ded-9680-bc75189a3b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5154dec7-b231-4ded-9680-bc75189a3b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849634a3-673f-4279-b40b-8bf19f23b6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849634a3-673f-4279-b40b-8bf19f23b6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afde7470-7a30-4ea4-aac2-ed46a8334341', 'volume_name': 'volume-afde7470-7a30-4ea4-aac2-ed46a8334341', 'volume_size': 2}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2642fdf-0320-481b-a7d1-beb59e49c682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2642fdf-0320-481b-a7d1-beb59e49c682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ffa4a5-43c3-43ef-9e4d-0f07ab712f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:34 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Volume afde7470-7a30-4ea4-aac2-ed46a8334341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afde7470-7a30-4ea4-aac2-ed46a8334341', 'volume_size': 2} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1981193386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afde7470-7a30-4ea4-aac2-ed46a8334341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90d7d85691e483785423bd68844795b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:34Z,use_quota=True,user_id='5392399c1bc141069ba3a49c3d229576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Creating volume afde7470-7a30-4ea4-aac2-ed46a8334341 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:34 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:32:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341 2147483648 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:34 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341 2147483648 Nov 03 20:32:34 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:35 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341 2147483648" returned: 0 in 0.445s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:35 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341 Nov 03 20:32:35 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:35 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341" returned: 0 in 0.232s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ffa4a5-43c3-43ef-9e4d-0f07ab712f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afde7470-7a30-4ea4-aac2-ed46a8334341', 'volume_size': 2}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b386043-45f5-4e86-958e-75a549680bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:35 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Volume volume-afde7470-7a30-4ea4-aac2-ed46a8334341 (afde7470-7a30-4ea4-aac2-ed46a8334341): created successfully Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b386043-45f5-4e86-958e-75a549680bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Flow 'volume_create_manager' (f6859d80-f881-4908-b4d5-048538e49b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5ff596f5-6dc3-4a6f-890e-99b898059190 tempest-VolumesCloneNegativeTest-326976576 None] Created volume successfully. Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Acquiring lock "cinder-afde7470-7a30-4ea4-aac2-ed46a8334341-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Lock "cinder-afde7470-7a30-4ea4-aac2-ed46a8334341-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Acquiring lock "cinder-quobyte-afde7470-7a30-4ea4-aac2-ed46a8334341" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Lock "cinder-quobyte-afde7470-7a30-4ea4-aac2-ed46a8334341" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6354ad-49b0-4057-89a7-2273fb660438]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:35 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341 Nov 03 20:32:35 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:36 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341" returned: 0 in 0.378s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:36 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341 Nov 03 20:32:36 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:36 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-afde7470-7a30-4ea4-aac2-ed46a8334341" returned: 0 in 0.242s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Lock "cinder-quobyte-afde7470-7a30-4ea4-aac2-ed46a8334341" released by "delete_volume" :: held 0.662s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Created reservations ['bc304f5c-faf3-4c23-a62c-7516939c0215', '57da01ab-96ad-4a93-8339-7842b0371a5f', 'a2751049-c6f0-4ce4-8c98-9197d1430ce6', 'e25a6462-ecc9-41ed-a19f-6043922d2a6b'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:36 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:32:36 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:36 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.249s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:36 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Deleted volume successfully. Nov 03 20:32:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-15417913-398c-4db5-9c84-d0ad10e7a3b7 tempest-VolumesCloneNegativeTest-326976576 None] Lock "cinder-afde7470-7a30-4ea4-aac2-ed46a8334341-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Flow 'volume_create_manager' (7932d3d9-39ed-4371-bed7-5d85053278b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81fb0467-97e0-410b-8542-86b25c10d91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81fb0467-97e0-410b-8542-86b25c10d91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1427917730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3b6ac4-1e3f-4299-abf5-ee72835264cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7c70ce98704ecaa39200101f83d518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:43Z,use_quota=True,user_id='0c255279f0164bb5b2a8cd759b1ca72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a262cfe1-a34c-46b2-9ed5-f664214291bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a262cfe1-a34c-46b2-9ed5-f664214291bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4d9934-d203-494c-8130-deb775da420f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4d9934-d203-494c-8130-deb775da420f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3b6ac4-1e3f-4299-abf5-ee72835264cc', 'volume_name': 'volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2093487d-70c1-4b89-8d14-2a478022bb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2093487d-70c1-4b89-8d14-2a478022bb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b6135b-fe1e-4a8e-ada5-0c66c29c5903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:42 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Volume eb3b6ac4-1e3f-4299-abf5-ee72835264cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc', 'volume_size': 1} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1427917730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3b6ac4-1e3f-4299-abf5-ee72835264cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7c70ce98704ecaa39200101f83d518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:43Z,use_quota=True,user_id='0c255279f0164bb5b2a8cd759b1ca72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Creating volume eb3b6ac4-1e3f-4299-abf5-ee72835264cc {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:42 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:32:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:42 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc 1073741824 Nov 03 20:32:42 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:43 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc 1073741824" returned: 0 in 0.394s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:43 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc Nov 03 20:32:43 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:43 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc" returned: 0 in 0.241s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b6135b-fe1e-4a8e-ada5-0c66c29c5903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8724b7-ad56-417d-924d-11d7bc49e4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:43 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Volume volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc (eb3b6ac4-1e3f-4299-abf5-ee72835264cc): created successfully Nov 03 20:32:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8724b7-ad56-417d-924d-11d7bc49e4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Flow 'volume_create_manager' (7932d3d9-39ed-4371-bed7-5d85053278b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:43 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ad7ff8a3-684f-4200-a508-a01bb935b8ab tempest-VolumesNegativeTest-1977425448 None] Created volume successfully. Nov 03 20:32:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=86,cinder:SELECT=50,cinder:DELETE=9,cinder:INSERT=17 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:32:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=52,cinder:INSERT=19,cinder:UPDATE=74,cinder:DELETE=6 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Acquiring lock "cinder-eb3b6ac4-1e3f-4299-abf5-ee72835264cc-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Lock "cinder-eb3b6ac4-1e3f-4299-abf5-ee72835264cc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Acquiring lock "cinder-quobyte-eb3b6ac4-1e3f-4299-abf5-ee72835264cc" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Lock "cinder-quobyte-eb3b6ac4-1e3f-4299-abf5-ee72835264cc" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d7d762-939a-4dc7-be6f-e05282d1453a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:59 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc Nov 03 20:32:59 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:59 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc" returned: 0 in 0.349s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:59 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc Nov 03 20:32:59 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:59 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-eb3b6ac4-1e3f-4299-abf5-ee72835264cc" returned: 0 in 0.237s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Lock "cinder-quobyte-eb3b6ac4-1e3f-4299-abf5-ee72835264cc" released by "delete_volume" :: held 0.627s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Created reservations ['14698021-90dc-4505-9465-0c07e0aa3e83', '8df58d9e-8e75-4eb4-9bf4-9376ab4052f4', 'df10d2bb-b513-4643-b4c6-be1865de853b', '33d1d8c0-1cf4-4bec-84a1-9d320e621cda'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:59 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:32:59 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:00 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.230s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:00 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:33:00 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Deleted volume successfully. Nov 03 20:33:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ef58ef4d-3440-4b15-ae03-c4accf5496a6 tempest-VolumesNegativeTest-1977425448 None] Lock "cinder-eb3b6ac4-1e3f-4299-abf5-ee72835264cc-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Flow 'volume_create_manager' (8cae2f0a-01fd-40d2-8473-74841b5524ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cc7d06-c5fe-41c9-8d7d-c0af310413a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cc7d06-c5fe-41c9-8d7d-c0af310413a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1326351547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9226584a-9bb5-4470-a602-078f09d8d6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2395244df6e4b4a94683c367b32c7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:03Z,use_quota=True,user_id='d05de74a10d147f3b4f361866750a6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47623168-05d0-4585-9430-0237379b941e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47623168-05d0-4585-9430-0237379b941e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aaf9eb-41e2-411f-a348-2c2ce300b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aaf9eb-41e2-411f-a348-2c2ce300b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9226584a-9bb5-4470-a602-078f09d8d6b1', 'volume_name': 'volume-9226584a-9bb5-4470-a602-078f09d8d6b1', 'volume_size': 2}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918e7303-5af6-4830-a87a-be7696a68819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918e7303-5af6-4830-a87a-be7696a68819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f37d87-2d92-45da-aca9-a43b83417358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:03 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Volume 9226584a-9bb5-4470-a602-078f09d8d6b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9226584a-9bb5-4470-a602-078f09d8d6b1', 'volume_size': 2} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1326351547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9226584a-9bb5-4470-a602-078f09d8d6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2395244df6e4b4a94683c367b32c7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:03Z,use_quota=True,user_id='d05de74a10d147f3b4f361866750a6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Creating volume 9226584a-9bb5-4470-a602-078f09d8d6b1 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:33:03 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 2147483648 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:03 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 2147483648 Nov 03 20:33:03 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:03 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 2147483648" returned: 0 in 0.454s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:03 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 Nov 03 20:33:03 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:04 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1" returned: 0 in 0.240s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f37d87-2d92-45da-aca9-a43b83417358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9226584a-9bb5-4470-a602-078f09d8d6b1', 'volume_size': 2}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cb76da-33d3-4edd-8a65-c173e19f0da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:04 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Volume volume-9226584a-9bb5-4470-a602-078f09d8d6b1 (9226584a-9bb5-4470-a602-078f09d8d6b1): created successfully Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cb76da-33d3-4edd-8a65-c173e19f0da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Flow 'volume_create_manager' (8cae2f0a-01fd-40d2-8473-74841b5524ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d9eb9e68-d929-40e6-bb55-5b43cf6b51a2 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Created volume successfully. Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Creating offline snapshot 3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 of volume 9226584a-9bb5-4470-a602-078f09d8d6b1 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81bf185-c8a0-4609-a438-7438d824f0e9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:04 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 Nov 03 20:33:04 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:04 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1" returned: 0 in 0.362s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 2G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:04 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 2G Nov 03 20:33:04 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:05 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 2G" returned: 0 in 0.373s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9226584a-9bb5-4470-a602-078f09d8d6b1 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:05 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9226584a-9bb5-4470-a602-078f09d8d6b1 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 Nov 03 20:33:05 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:05 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9226584a-9bb5-4470-a602-078f09d8d6b1 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86" returned: 0 in 0.286s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:05 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 is being set with open permissions: ugo+rw Nov 03 20:33:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:05 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 Nov 03 20:33:05 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:05 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86" returned: 0 in 0.240s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:05 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.info Nov 03 20:33:05 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:06 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.info" returned: 0 in 0.269s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:06 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.info is being set with open permissions: ugo+rw Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:06 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.info Nov 03 20:33:06 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:06 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.info" returned: 0 in 0.243s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:06 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b6b56bc4-6438-45da-8175-7d208c1e537f tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Create snapshot completed successfully Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Acquiring lock "cinder-3b751f8e-6bfb-405c-9ccb-27b1f28b8a86-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "cinder-3b751f8e-6bfb-405c-9ccb-27b1f28b8a86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Acquiring lock "cinder-quobyte-9226584a-9bb5-4470-a602-078f09d8d6b1" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "cinder-quobyte-9226584a-9bb5-4470-a602-078f09d8d6b1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Acquiring lock "cinder-quobyte-3b751f8e-6bfb-405c-9ccb-27b1f28b8a86" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "cinder-quobyte-3b751f8e-6bfb-405c-9ccb-27b1f28b8a86" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Deleting offline snapshot 3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 of volume 9226584a-9bb5-4470-a602-078f09d8d6b1 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] snapshot_file for this snap is: volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[be71d453-ea52-47c8-a20c-bef942c808ca]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:06 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 Nov 03 20:33:06 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:07 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86" returned: 0 in 0.341s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9226584a-9bb5-4470-a602-078f09d8d6b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:33:07 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7de2567-66b2-400f-9d68-1d662a05b897]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:07 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 Nov 03 20:33:07 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:07 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1" returned: 0 in 0.348s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:07 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 Nov 03 20:33:07 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:07 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86" returned: 0 in 0.338s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:07 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86 Nov 03 20:33:07 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:08 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1.3b751f8e-6bfb-405c-9ccb-27b1f28b8a86" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "cinder-quobyte-3b751f8e-6bfb-405c-9ccb-27b1f28b8a86" released by "_delete_snapshot" :: held 1.381s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "cinder-quobyte-9226584a-9bb5-4470-a602-078f09d8d6b1" released by "delete_snapshot" :: held 1.403s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:08 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Created reservations ['4b6ee1e6-3e37-43cc-8eac-13ac4ab8558b', 'b24b1e2e-93a1-44d8-925b-88ad61d70947', '88007078-5f56-4f12-ae27-ef03a08e86e6', '934ec34d-4cf7-4319-b876-1d2a1ae55ec0'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:33:08 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Delete snapshot completed successfully. Nov 03 20:33:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3b5c1e6c-9554-4531-a99c-91e37bfec646 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "cinder-3b751f8e-6bfb-405c-9ccb-27b1f28b8a86-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Acquiring lock "cinder-9226584a-9bb5-4470-a602-078f09d8d6b1-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "cinder-9226584a-9bb5-4470-a602-078f09d8d6b1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Acquiring lock "cinder-quobyte-9226584a-9bb5-4470-a602-078f09d8d6b1" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "cinder-quobyte-9226584a-9bb5-4470-a602-078f09d8d6b1" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[594a2ade-9b70-4604-931c-dc527f89c21d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:09 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 Nov 03 20:33:09 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:09 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1" returned: 0 in 0.346s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:09 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1 Nov 03 20:33:09 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:09 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9226584a-9bb5-4470-a602-078f09d8d6b1" returned: 0 in 0.237s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "cinder-quobyte-9226584a-9bb5-4470-a602-078f09d8d6b1" released by "delete_volume" :: held 0.640s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Created reservations ['1559fcb5-6bb0-4136-b3f2-a5e245dec711', '1bcabf8b-bf03-45c6-8a3a-31df3736ac91', '95c767f1-3e08-4129-9110-e50d898b99a9', '7d6b2c34-2134-4f5d-8be9-beb3621d36c8'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:09 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:33:09 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:09 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.239s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:33:09 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Deleted volume successfully. Nov 03 20:33:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-986a08f1-b5ad-4cca-a6f9-4a8c8b1fe100 tempest-VolumesSnapshotNegativeTestJSON-27988063 None] Lock "cinder-9226584a-9bb5-4470-a602-078f09d8d6b1-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:19 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=19,cinder:INSERT=8,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:33:19 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:23 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:33:23 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:23 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.247s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:33:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:33:34 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:33:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Flow 'volume_create_manager' (c5a8e185-805d-4d38-b0a7-2faf662c6682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42515957-91e5-47d4-9031-a7663a7f1b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42515957-91e5-47d4-9031-a7663a7f1b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-41568479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d52bad7-8c2b-4b2b-a3f5-13e9a613843d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259ee56c6aa840799b66c260057c065c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:35Z,use_quota=True,user_id='3879665cf7134819b75cb782ee7301af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5b2b890-80f3-4d34-ab13-c58edd0d70b2),volume_type_id=f5b2b890-80f3-4d34-ab13-c58edd0d70b2)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55185a58-5a16-427e-b164-a9c7d6328aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55185a58-5a16-427e-b164-a9c7d6328aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227060af-e356-4b65-8f28-d14f728ec037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227060af-e356-4b65-8f28-d14f728ec037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d52bad7-8c2b-4b2b-a3f5-13e9a613843d', 'volume_name': 'volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e520d868-81a7-408b-8079-862ffa36b4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:34 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e520d868-81a7-408b-8079-862ffa36b4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edadb72-661c-4e36-8d6f-8cb6b4e055bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:35 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Volume 2d52bad7-8c2b-4b2b-a3f5-13e9a613843d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d', 'volume_size': 1} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-41568479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d52bad7-8c2b-4b2b-a3f5-13e9a613843d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259ee56c6aa840799b66c260057c065c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:35Z,use_quota=True,user_id='3879665cf7134819b75cb782ee7301af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5b2b890-80f3-4d34-ab13-c58edd0d70b2),volume_type_id=f5b2b890-80f3-4d34-ab13-c58edd0d70b2)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Creating volume 2d52bad7-8c2b-4b2b-a3f5-13e9a613843d {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:33:35 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:35 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d 1073741824 Nov 03 20:33:35 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Flow 'volume_create_manager' (33bc2598-0c5c-42b3-8df6-4bb9f5503f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39194e1f-93f5-4449-a02e-7f5d5ed288dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39194e1f-93f5-4449-a02e-7f5d5ed288dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-339242822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfe1afe-20fa-4527-9a1e-bb702416fe3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259ee56c6aa840799b66c260057c065c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:35Z,use_quota=True,user_id='3879665cf7134819b75cb782ee7301af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54e89aea-aac2-41c5-a290-e224db2e189b),volume_type_id=54e89aea-aac2-41c5-a290-e224db2e189b)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61695465-e600-4fda-ad3d-12bf3ce36aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61695465-e600-4fda-ad3d-12bf3ce36aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d0abd2-b9e4-41ad-8875-4b6920a83ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d0abd2-b9e4-41ad-8875-4b6920a83ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbfe1afe-20fa-4527-9a1e-bb702416fe3d', 'volume_name': 'volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f766c9-1d82-4886-bdd3-2eb90cd6535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f766c9-1d82-4886-bdd3-2eb90cd6535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9dd54e-da57-4e2e-829a-83789d382993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:35 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Volume fbfe1afe-20fa-4527-9a1e-bb702416fe3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d', 'volume_size': 1} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:35 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d 1073741824" returned: 0 in 0.471s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:35 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d Nov 03 20:33:35 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:35 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d" returned: 0 in 0.246s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-339242822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfe1afe-20fa-4527-9a1e-bb702416fe3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259ee56c6aa840799b66c260057c065c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:35Z,use_quota=True,user_id='3879665cf7134819b75cb782ee7301af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54e89aea-aac2-41c5-a290-e224db2e189b),volume_type_id=54e89aea-aac2-41c5-a290-e224db2e189b)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Creating volume fbfe1afe-20fa-4527-9a1e-bb702416fe3d {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:33:35 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:35 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d 1073741824 Nov 03 20:33:35 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edadb72-661c-4e36-8d6f-8cb6b4e055bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ff66f9-b0c1-4e22-8757-df1832b3ee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:35 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Volume volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d (2d52bad7-8c2b-4b2b-a3f5-13e9a613843d): created successfully Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ff66f9-b0c1-4e22-8757-df1832b3ee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Flow 'volume_create_manager' (c5a8e185-805d-4d38-b0a7-2faf662c6682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Flow 'volume_create_manager' (1e48521b-4029-4502-b894-572bce03720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f66b417-af82-4a5f-aead-51dd34a8848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-48459c9b-2221-4fa5-a922-54e07c3f0304 tempest-TestInstancesWithCinderVolumes-1510552642 None] Created volume successfully. Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f66b417-af82-4a5f-aead-51dd34a8848a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1306829164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560b95d8-1f86-485a-a7bf-ac548ae8e4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259ee56c6aa840799b66c260057c065c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:36Z,use_quota=True,user_id='3879665cf7134819b75cb782ee7301af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea12fd25-f30f-4f6e-8880-86bd51380590),volume_type_id=ea12fd25-f30f-4f6e-8880-86bd51380590)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a321fe12-d7ac-44ae-ae4d-ff82a99ab8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a321fe12-d7ac-44ae-ae4d-ff82a99ab8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b5a0c8-73fb-4cc7-b148-3ec1dfa18742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:35 devstack cinder-volume[87342]: DEBUG cinder.image.glance [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Creating Keystone auth plugin from conf {{(pid=87342) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b5a0c8-73fb-4cc7-b148-3ec1dfa18742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '560b95d8-1f86-485a-a7bf-ac548ae8e4d5', 'volume_name': 'volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5', 'volume_size': 1, 'image_id': '2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--765629542', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '259ee56c6aa840799b66c260057c065c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'created_at': datetime.datetime(2026, 11, 3, 19, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37/file', 'properties': {}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce31923-9359-4097-a883-548140e362eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce31923-9359-4097-a883-548140e362eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7fed87-f831-4594-ab9c-451a869c6add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Volume 560b95d8-1f86-485a-a7bf-ac548ae8e4d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5', 'volume_size': 1, 'image_id': '2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--765629542', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '259ee56c6aa840799b66c260057c065c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'created_at': datetime.datetime(2026, 11, 3, 19, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37/file', 'properties': {}}, 'image_service': } Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Trying to clone 560b95d8-1f86-485a-a7bf-ac548ae8e4d5 from image 2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'metadata': {}}]). {{(pid=87342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:33:36 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d 1073741824" returned: 0 in 0.464s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:36 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d Nov 03 20:33:36 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:36 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d" returned: 0 in 0.266s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9dd54e-da57-4e2e-829a-83789d382993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b54e46a-efda-46ea-b867-6daa2aa916fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Volume volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d (fbfe1afe-20fa-4527-9a1e-bb702416fe3d): created successfully Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b54e46a-efda-46ea-b867-6daa2aa916fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Flow 'volume_create_manager' (33bc2598-0c5c-42b3-8df6-4bb9f5503f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:36 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-434ed452-6f8d-4b0a-b1d1-3508d5dc45e4 tempest-TestInstancesWithCinderVolumes-1510552642 None] Created volume successfully. Nov 03 20:33:38 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD, size 20.69 MB, duration 2.82 sec {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:33:38 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Image download 20.69 MB at 7.35 MB/s Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf332b9-d500-4d4e-aabf-235b80f6e562]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:39 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD Nov 03 20:33:39 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:39 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Temporary image 2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37 is fetched for user 3879665cf7134819b75cb782ee7301af. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3572842f-ae24-4092-a444-6826575a9993]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:39 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD Nov 03 20:33:39 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:39 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1306829164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560b95d8-1f86-485a-a7bf-ac548ae8e4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259ee56c6aa840799b66c260057c065c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:36Z,use_quota=True,user_id='3879665cf7134819b75cb782ee7301af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea12fd25-f30f-4f6e-8880-86bd51380590),volume_type_id=ea12fd25-f30f-4f6e-8880-86bd51380590)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Creating volume 560b95d8-1f86-485a-a7bf-ac548ae8e4d5 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:33:39 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:33:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:39 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 1073741824 Nov 03 20:33:39 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:40 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 1073741824" returned: 0 in 0.403s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:40 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 Nov 03 20:33:40 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:40 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5" returned: 0 in 0.237s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:33:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:40 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Attempting download of 2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37 ((None, [{'url': 'file:///opt/stack/data/glance/images/2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'metadata': {}}])) to volume 560b95d8-1f86-485a-a7bf-ac548ae8e4d5. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:33:40 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c61faf0-28cf-47d6-8d7a-202e2aa7b9e6]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_7mcwkpja {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:40 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_7mcwkpja Nov 03 20:33:40 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:40 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_7mcwkpja" returned: 0 in 0.320s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_7mcwkpja {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:41 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_7mcwkpja Nov 03 20:33:41 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:41 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_7mcwkpja" returned: 1 in 0.316s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_7mcwkpja' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:33:41 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7346c21d-ef26-4e2c-b859-e0bf7e4e11fb]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:41 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD Nov 03 20:33:41 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:41 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:41 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] 2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37 was qcow2, converting to qcow2 {{(pid=87342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:33:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:41 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 Nov 03 20:33:41 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:43 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5" returned: 0 in 1.652s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37_l5d239ojdevstack@QuobyteHD, size 112.00 MB, duration 1.65 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:33:43 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Converted 112.00 MB image at 67.76 MB/s Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:43 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 1G Nov 03 20:33:43 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:43 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 1G" returned: 0 in 0.305s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Downloaded image 2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37 ((None, [{'url': 'file:///opt/stack/data/glance/images/2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'metadata': {}}])) to volume 560b95d8-1f86-485a-a7bf-ac548ae8e4d5 successfully. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Temporary image 2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37 for user 3879665cf7134819b75cb782ee7301af is deleted. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Marking volume 560b95d8-1f86-485a-a7bf-ac548ae8e4d5 as bootable. {{(pid=87342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Copying metadata from image 2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37 to 560b95d8-1f86-485a-a7bf-ac548ae8e4d5. {{(pid=87342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Creating volume glance metadata for volume 560b95d8-1f86-485a-a7bf-ac548ae8e4d5 backed by image 2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37 with: {'image_id': '2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'image_name': 'tempest-scenario-img--765629542', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7fed87-f831-4594-ab9c-451a869c6add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5', 'volume_size': 1, 'image_id': '2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--765629542', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '259ee56c6aa840799b66c260057c065c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37', 'created_at': datetime.datetime(2026, 11, 3, 19, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2907bbb2-206b-4df2-ab0b-2bb7b7c1ca37/file', 'properties': {}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4f0093-a852-4c71-8bef-605585ddd40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:43 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Volume volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 (560b95d8-1f86-485a-a7bf-ac548ae8e4d5): created successfully Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4f0093-a852-4c71-8bef-605585ddd40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Flow 'volume_create_manager' (1e48521b-4029-4502-b894-572bce03720b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:43 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2db2463a-726c-4e24-9f2b-d050ae97cd70 tempest-TestInstancesWithCinderVolumes-1510552642 None] Created volume successfully. Nov 03 20:33:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-3e4a58fd-8f25-43b4-af08-11d50c2a0d51 req-0a4223aa-dad2-474f-b203-434cec2f55d1 tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-3e4a58fd-8f25-43b4-af08-11d50c2a0d51 req-0a4223aa-dad2-474f-b203-434cec2f55d1 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-3e4a58fd-8f25-43b4-af08-11d50c2a0d51 req-0a4223aa-dad2-474f-b203-434cec2f55d1 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-3e4a58fd-8f25-43b4-af08-11d50c2a0d51 req-0a4223aa-dad2-474f-b203-434cec2f55d1 tempest-TestInstancesWithCinderVolumes-1510552642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '715850a1-e049-4083-ad6a-e1983c152b0f', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:33:46 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-3e4a58fd-8f25-43b4-af08-11d50c2a0d51 req-0a4223aa-dad2-474f-b203-434cec2f55d1 tempest-TestInstancesWithCinderVolumes-1510552642 None] attachment_update completed successfully. Nov 03 20:33:56 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=11 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:33:56 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=14,cinder:SELECT=19,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:34:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-f674d60e-1931-4765-a87e-7a9471f5e4aa req-a2fa2b60-0eef-4d8c-b30c-939a623385ef tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-f674d60e-1931-4765-a87e-7a9471f5e4aa req-a2fa2b60-0eef-4d8c-b30c-939a623385ef tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-f674d60e-1931-4765-a87e-7a9471f5e4aa req-a2fa2b60-0eef-4d8c-b30c-939a623385ef tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-f674d60e-1931-4765-a87e-7a9471f5e4aa req-a2fa2b60-0eef-4d8c-b30c-939a623385ef tempest-TestInstancesWithCinderVolumes-1510552642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '182c8e10-66af-4271-836c-8576fc0516a4', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:34:18 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-f674d60e-1931-4765-a87e-7a9471f5e4aa req-a2fa2b60-0eef-4d8c-b30c-939a623385ef tempest-TestInstancesWithCinderVolumes-1510552642 None] attachment_update completed successfully. Nov 03 20:34:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-ae2ab83f-1c15-4a20-b3da-e5a8e0b559bc req-eba2c3db-23e4-420a-b262-5d249ea9da7c tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-ae2ab83f-1c15-4a20-b3da-e5a8e0b559bc req-eba2c3db-23e4-420a-b262-5d249ea9da7c tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-ae2ab83f-1c15-4a20-b3da-e5a8e0b559bc req-eba2c3db-23e4-420a-b262-5d249ea9da7c tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-ae2ab83f-1c15-4a20-b3da-e5a8e0b559bc req-eba2c3db-23e4-420a-b262-5d249ea9da7c tempest-TestInstancesWithCinderVolumes-1510552642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fabd768-3885-4953-a202-1a36270ee7e4', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:34:20 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-ae2ab83f-1c15-4a20-b3da-e5a8e0b559bc req-eba2c3db-23e4-420a-b262-5d249ea9da7c tempest-TestInstancesWithCinderVolumes-1510552642 None] attachment_update completed successfully. Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:23 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:34:23 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:23 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.241s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:34:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:34:24 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-63d8ab00-f119-4c2b-965f-24d6d4378967 req-944e2314-61ae-4f3b-a361-a8fa6c3f360a tempest-TestInstancesWithCinderVolumes-1510552642 None] Terminate volume connection completed successfully. Nov 03 20:34:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-63d8ab00-f119-4c2b-965f-24d6d4378967 req-944e2314-61ae-4f3b-a361-a8fa6c3f360a tempest-TestInstancesWithCinderVolumes-1510552642 None] Deleting attachment 182c8e10-66af-4271-836c-8576fc0516a4. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:34:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "cinder-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "cinder-quobyte-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-quobyte-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:25 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4450574-505a-44b7-8487-0c704807d5ab]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:25 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d Nov 03 20:34:25 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:25 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d" returned: 0 in 0.380s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:25 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d Nov 03 20:34:25 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:26 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-quobyte-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d" released by "delete_volume" :: held 0.676s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:26 devstack cinder-volume[87342]: WARNING cinder.quota [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2055062657-662748455 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2055062657-662748455, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:34:26 devstack cinder-volume[87342]: WARNING cinder.quota [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2055062657-662748455 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2055062657-662748455, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Created reservations ['206ed5ce-f64f-4215-b8c2-31eae4affce7', 'ec319045-0f48-4eaa-8324-b638ebdbad32', '53ff994d-5bce-4d75-83bb-94ce1a254802', 'e218bece-41af-4be1-8643-26ab5e0a88b9'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:26 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:34:26 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:26 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.247s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:34:26 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Deleted volume successfully. Nov 03 20:34:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-01bce576-8d05-4267-b828-3bcad79f757d tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-2d52bad7-8c2b-4b2b-a3f5-13e9a613843d-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:28 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-0c5897da-788b-4c29-bb7e-b7118772fa86 req-62b985a9-51d7-4481-8223-317e4405d58f tempest-TestInstancesWithCinderVolumes-1510552642 None] Terminate volume connection completed successfully. Nov 03 20:34:28 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-0c5897da-788b-4c29-bb7e-b7118772fa86 req-62b985a9-51d7-4481-8223-317e4405d58f tempest-TestInstancesWithCinderVolumes-1510552642 None] Deleting attachment 8fabd768-3885-4953-a202-1a36270ee7e4. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:34:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "cinder-fbfe1afe-20fa-4527-9a1e-bb702416fe3d-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-fbfe1afe-20fa-4527-9a1e-bb702416fe3d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "cinder-quobyte-fbfe1afe-20fa-4527-9a1e-bb702416fe3d" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-quobyte-fbfe1afe-20fa-4527-9a1e-bb702416fe3d" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:29 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dac27d-ea25-4f13-97e6-e5ceb26946f5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:29 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d Nov 03 20:34:29 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:29 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d" returned: 0 in 0.382s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:30 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d Nov 03 20:34:30 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:30 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fbfe1afe-20fa-4527-9a1e-bb702416fe3d" returned: 0 in 0.252s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-quobyte-fbfe1afe-20fa-4527-9a1e-bb702416fe3d" released by "delete_volume" :: held 0.682s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:30 devstack cinder-volume[87342]: WARNING cinder.quota [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1996420787-1937411134 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1996420787-1937411134, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:34:30 devstack cinder-volume[87342]: WARNING cinder.quota [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1996420787-1937411134 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1996420787-1937411134, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Created reservations ['41ee8a07-0cba-41ba-a8fa-815ea3c1c337', '39d0097d-a246-4eb4-8b87-3108c8e90c41', '0cc25b38-f469-4e38-9dae-fdeec6905a9c', 'd05d8f80-b7e7-4f56-8b01-3f6cb1ab6ab3'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:30 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:34:30 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:30 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.254s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:34:30 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Deleted volume successfully. Nov 03 20:34:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c8d7605a-ba8d-492e-a735-b11cf8adfe0c tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-fbfe1afe-20fa-4527-9a1e-bb702416fe3d-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:33 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-b5756768-72c5-4ca5-a489-0254e1e30a9b req-40daedd5-bea4-4c3d-aa25-71689eaa834e tempest-TestInstancesWithCinderVolumes-1510552642 None] Terminate volume connection completed successfully. Nov 03 20:34:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-b5756768-72c5-4ca5-a489-0254e1e30a9b req-40daedd5-bea4-4c3d-aa25-71689eaa834e tempest-TestInstancesWithCinderVolumes-1510552642 None] Deleting attachment 715850a1-e049-4083-ad6a-e1983c152b0f. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:34:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "cinder-560b95d8-1f86-485a-a7bf-ac548ae8e4d5-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-560b95d8-1f86-485a-a7bf-ac548ae8e4d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "cinder-quobyte-560b95d8-1f86-485a-a7bf-ac548ae8e4d5" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-quobyte-560b95d8-1f86-485a-a7bf-ac548ae8e4d5" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:34 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5b1c63-0e82-4669-b353-fedca7fe996b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:34 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 Nov 03 20:34:34 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:34 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5" returned: 0 in 0.375s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:34 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5 Nov 03 20:34:34 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:35 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-560b95d8-1f86-485a-a7bf-ac548ae8e4d5" returned: 0 in 0.240s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-quobyte-560b95d8-1f86-485a-a7bf-ac548ae8e4d5" released by "delete_volume" :: held 0.657s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:35 devstack cinder-volume[87342]: WARNING cinder.quota [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2139902098-659361137 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2139902098-659361137, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:34:35 devstack cinder-volume[87342]: WARNING cinder.quota [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2139902098-659361137 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2139902098-659361137, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Created reservations ['ad1e22f2-56e5-49d3-960e-b4fa0bd2d742', '80daea66-b788-40a3-b0b3-f354a06962a7', '5a67e827-b767-4be6-b03d-fb7fdd0796e0', '0ccd30e9-a80a-4776-a9aa-4230c2a34402'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:35 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:34:35 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:35 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.240s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:34:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Deleted volume successfully. Nov 03 20:34:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-dedf63bf-a306-4aec-8a3b-ac4a1352ed10 tempest-TestInstancesWithCinderVolumes-1510552642 None] Lock "cinder-560b95d8-1f86-485a-a7bf-ac548ae8e4d5-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:45 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=26,cinder:UPDATE=29,cinder:INSERT=7 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:34:45 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=36,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Flow 'volume_create_manager' (f0c0df0c-65a0-43fe-90f9-9ecc9d156c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517997a4-3982-43db-8054-8ed17a3d2c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517997a4-3982-43db-8054-8ed17a3d2c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1994064255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb83829-d4ed-4412-9f7b-912fa2c38aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be07e03b21fe4e6788341bebeb276504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:35:17Z,use_quota=True,user_id='22f6af8b271e4c12a86dcfc5e41b1716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309740a9-d913-48df-b2ea-ea2fd391b194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309740a9-d913-48df-b2ea-ea2fd391b194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7cfe653-93e8-4eb0-a83d-6ad049173299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7cfe653-93e8-4eb0-a83d-6ad049173299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb83829-d4ed-4412-9f7b-912fa2c38aaf', 'volume_name': 'volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59caf04e-630e-4f2c-9463-a4087d7a8dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59caf04e-630e-4f2c-9463-a4087d7a8dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9a6999-de73-4ca5-9ebc-4ae0165f0020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:17 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Volume 4fb83829-d4ed-4412-9f7b-912fa2c38aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf', 'volume_size': 1} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1994064255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb83829-d4ed-4412-9f7b-912fa2c38aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be07e03b21fe4e6788341bebeb276504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:35:17Z,use_quota=True,user_id='22f6af8b271e4c12a86dcfc5e41b1716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Creating volume 4fb83829-d4ed-4412-9f7b-912fa2c38aaf {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:35:17 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:17 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf 1073741824 Nov 03 20:35:17 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:17 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf 1073741824" returned: 0 in 0.426s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:17 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf Nov 03 20:35:17 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:17 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf" returned: 0 in 0.258s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9a6999-de73-4ca5-9ebc-4ae0165f0020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a68bfbc-ef34-44bd-b730-f5cca9c2eb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:17 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Volume volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf (4fb83829-d4ed-4412-9f7b-912fa2c38aaf): created successfully Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a68bfbc-ef34-44bd-b730-f5cca9c2eb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Flow 'volume_create_manager' (f0c0df0c-65a0-43fe-90f9-9ecc9d156c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:35:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-dcfe5719-9203-4c95-bf1d-b9328569f363 tempest-TestMinimumBasicScenario-578292093 None] Created volume successfully. Nov 03 20:35:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-40fed5e7-eac8-4351-a3c2-c647bbddb831 req-5dd0765a-ccc8-4510-a02c-eadc612e598c tempest-TestMinimumBasicScenario-578292093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:35:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-40fed5e7-eac8-4351-a3c2-c647bbddb831 req-5dd0765a-ccc8-4510-a02c-eadc612e598c tempest-TestMinimumBasicScenario-578292093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:35:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-40fed5e7-eac8-4351-a3c2-c647bbddb831 req-5dd0765a-ccc8-4510-a02c-eadc612e598c tempest-TestMinimumBasicScenario-578292093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:35:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-40fed5e7-eac8-4351-a3c2-c647bbddb831 req-5dd0765a-ccc8-4510-a02c-eadc612e598c tempest-TestMinimumBasicScenario-578292093 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c5eff90-c077-45f1-a2de-0147a6c11066', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:35:19 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-40fed5e7-eac8-4351-a3c2-c647bbddb831 req-5dd0765a-ccc8-4510-a02c-eadc612e598c tempest-TestMinimumBasicScenario-578292093 None] attachment_update completed successfully. Nov 03 20:35:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:35:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:35:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:35:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:35:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:35:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:35:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:23 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:35:23 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:24 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.390s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:35:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:35:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:35:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:35:29 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=6,cinder:SELECT=8,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:35:29 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:35:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:35:53 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:36:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-f5c60ca2-f99f-440c-941c-9339a9223f3a req-756ce72f-e013-4635-b616-cd25c172abf3 tempest-TestMinimumBasicScenario-578292093 None] Terminate volume connection completed successfully. Nov 03 20:36:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-f5c60ca2-f99f-440c-941c-9339a9223f3a req-756ce72f-e013-4635-b616-cd25c172abf3 tempest-TestMinimumBasicScenario-578292093 None] Deleting attachment 8c5eff90-c077-45f1-a2de-0147a6c11066. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Acquiring lock "cinder-4fb83829-d4ed-4412-9f7b-912fa2c38aaf-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Lock "cinder-4fb83829-d4ed-4412-9f7b-912fa2c38aaf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Acquiring lock "cinder-quobyte-4fb83829-d4ed-4412-9f7b-912fa2c38aaf" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Lock "cinder-quobyte-4fb83829-d4ed-4412-9f7b-912fa2c38aaf" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e5ff3b-3ae4-49ac-a25a-4c4b354e4a38]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:05 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf Nov 03 20:36:05 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:05 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf" returned: 0 in 0.351s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:05 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf Nov 03 20:36:05 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:05 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4fb83829-d4ed-4412-9f7b-912fa2c38aaf" returned: 0 in 0.241s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Lock "cinder-quobyte-4fb83829-d4ed-4412-9f7b-912fa2c38aaf" released by "delete_volume" :: held 0.635s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Created reservations ['562faf6d-f366-49b4-a27f-2ec9c9ad9253', '42557b5e-2f50-4346-9bdf-f529fe833b08', '673b6af0-f54e-4980-bfbf-c9ba2d1b80dc', '89f2d6b6-4df2-4219-ab32-f57bde212dfe'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:05 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:36:05 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:06 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.234s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:06 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:06 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Deleted volume successfully. Nov 03 20:36:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d9a75654-0168-4cd8-9452-10322b10c9a4 tempest-TestMinimumBasicScenario-578292093 None] Lock "cinder-4fb83829-d4ed-4412-9f7b-912fa2c38aaf-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:15 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:36:16 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:23 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:36:23 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:23 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.263s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:36:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:37:04 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Flow 'volume_create_manager' (78e97974-d7dc-4d66-bf5a-dafbedb32e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36524577-50a9-45ae-a403-61af5a314536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36524577-50a9-45ae-a403-61af5a314536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-54518900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36fcc28-850c-4425-b362-e9f2145da6c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e632bb757b4684a41c39d8767f332e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:05Z,use_quota=True,user_id='7d9901fc9fa34bf1a5c679d239c1793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d9dba1-b90d-4487-8f85-c8488505c4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d9dba1-b90d-4487-8f85-c8488505c4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e089f00-6431-49c9-96f5-12939ac1757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e089f00-6431-49c9-96f5-12939ac1757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36fcc28-850c-4425-b362-e9f2145da6c0', 'volume_name': 'volume-c36fcc28-850c-4425-b362-e9f2145da6c0', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5dd1bc-ef6d-4afb-84a9-364b110c6e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5dd1bc-ef6d-4afb-84a9-364b110c6e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff110f00-459f-4c2b-b0c3-72596698ae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:05 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Volume c36fcc28-850c-4425-b362-e9f2145da6c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36fcc28-850c-4425-b362-e9f2145da6c0', 'volume_size': 1} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-54518900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36fcc28-850c-4425-b362-e9f2145da6c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e632bb757b4684a41c39d8767f332e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:05Z,use_quota=True,user_id='7d9901fc9fa34bf1a5c679d239c1793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Creating volume c36fcc28-850c-4425-b362-e9f2145da6c0 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:05 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:05 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0 1073741824 Nov 03 20:37:05 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:05 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0 1073741824" returned: 0 in 0.383s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:05 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0 Nov 03 20:37:05 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:05 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0" returned: 0 in 0.235s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] <== create_volume: return (658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff110f00-459f-4c2b-b0c3-72596698ae6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36fcc28-850c-4425-b362-e9f2145da6c0', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f5de03-75be-49c1-a923-5868866b01f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:05 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Volume volume-c36fcc28-850c-4425-b362-e9f2145da6c0 (c36fcc28-850c-4425-b362-e9f2145da6c0): created successfully Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f5de03-75be-49c1-a923-5868866b01f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:05 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Flow 'volume_create_manager' (78e97974-d7dc-4d66-bf5a-dafbedb32e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:05 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-00c4334d-a658-40b9-b0f2-1287ca5be0c9 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Created volume successfully. Nov 03 20:37:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-56d2480d-ccac-4d13-8299-e57af97934a5 req-987150c6-df89-4cb1-b2ee-43d0ac23de83 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-56d2480d-ccac-4d13-8299-e57af97934a5 req-987150c6-df89-4cb1-b2ee-43d0ac23de83 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-56d2480d-ccac-4d13-8299-e57af97934a5 req-987150c6-df89-4cb1-b2ee-43d0ac23de83 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:06 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-56d2480d-ccac-4d13-8299-e57af97934a5 req-987150c6-df89-4cb1-b2ee-43d0ac23de83 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-c36fcc28-850c-4425-b362-e9f2145da6c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0938061a-2635-42ac-9384-9f0014ba77f8', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:37:06 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-56d2480d-ccac-4d13-8299-e57af97934a5 req-987150c6-df89-4cb1-b2ee-43d0ac23de83 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] attachment_update completed successfully. Nov 03 20:37:08 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-7ee00419-9ea6-4a63-8d92-58c43019c9fb req-6fc189f2-53d9-47ac-9dfe-10d6b042ec0f tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Terminate volume connection completed successfully. Nov 03 20:37:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-7ee00419-9ea6-4a63-8d92-58c43019c9fb req-6fc189f2-53d9-47ac-9dfe-10d6b042ec0f tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Deleting attachment 0938061a-2635-42ac-9384-9f0014ba77f8. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:37:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Acquiring lock "cinder-c36fcc28-850c-4425-b362-e9f2145da6c0-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "cinder-c36fcc28-850c-4425-b362-e9f2145da6c0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Acquiring lock "cinder-quobyte-c36fcc28-850c-4425-b362-e9f2145da6c0" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "cinder-quobyte-c36fcc28-850c-4425-b362-e9f2145da6c0" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:09 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[736a8a14-5b19-468d-8dc9-237f9d84204a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:09 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0 Nov 03 20:37:09 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:09 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0" returned: 0 in 0.351s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:09 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0 Nov 03 20:37:09 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:10 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-c36fcc28-850c-4425-b362-e9f2145da6c0" returned: 0 in 0.259s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "cinder-quobyte-c36fcc28-850c-4425-b362-e9f2145da6c0" released by "delete_volume" :: held 0.650s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Created reservations ['be765165-674e-41a3-80ff-bc1a62cd4b79', '86c03a6e-67d7-4c55-a039-ec77ce02931f', 'b8aaf4aa-6b52-480e-a190-5a78e9c4febd', '22217c1b-bb29-48fc-b662-575685a14e78'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:10 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:37:10 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:10 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.243s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Deleted volume successfully. Nov 03 20:37:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-952fe73a-46f0-47a9-9436-50c9c72230c5 tempest-TestServerVolumeAttachScenarioOldVersion-147013870 None] Lock "cinder-c36fcc28-850c-4425-b362-e9f2145da6c0-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:20 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=11,cinder:SELECT=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:37:20 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=16,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:23 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:37:23 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:23 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.250s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:37:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:37:45 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Flow 'volume_create_manager' (1875c940-7bf3-4a70-a314-c6d5028fcd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09dc888-1021-4464-9aae-01072a685016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09dc888-1021-4464-9aae-01072a685016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2022248431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5da05f-46c1-4839-9b45-5c62bb98203d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8123a3d7f4264bf09f1d496bb859729d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:46Z,use_quota=True,user_id='7b64afaf953a4d998106a84d247f0063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e07022f-99f7-47c7-9b31-6dc854653ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e07022f-99f7-47c7-9b31-6dc854653ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64492531-29f1-4d92-aa46-5ceac106ddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:45 devstack cinder-volume[87342]: DEBUG cinder.image.glance [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Creating Keystone auth plugin from conf {{(pid=87342) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:37:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64492531-29f1-4d92-aa46-5ceac106ddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba5da05f-46c1-4839-9b45-5c62bb98203d', 'volume_name': 'volume-ba5da05f-46c1-4839-9b45-5c62bb98203d', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fafa61-730a-43fa-9a5e-d9f89d6f85ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fafa61-730a-43fa-9a5e-d9f89d6f85ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3c3867-1c3c-4f74-8185-bf129cfcfd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:46 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Volume ba5da05f-46c1-4839-9b45-5c62bb98203d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba5da05f-46c1-4839-9b45-5c62bb98203d', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 20:37:46 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Trying to clone ba5da05f-46c1-4839-9b45-5c62bb98203d from image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 at location (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]). {{(pid=87342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:37:46 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:37:46 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Image download 20.69 MB at 20.69 MB/s Nov 03 20:37:46 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaefdc1-69cf-4e09-8d1a-60c4305aa4f5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:46 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD Nov 03 20:37:46 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:46 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:46 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Temporary image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 is fetched for user 7b64afaf953a4d998106a84d247f0063. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f08a679-2cb4-44ab-ac86-55ecf84396c0]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:47 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD Nov 03 20:37:47 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:47 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2022248431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5da05f-46c1-4839-9b45-5c62bb98203d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8123a3d7f4264bf09f1d496bb859729d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:46Z,use_quota=True,user_id='7b64afaf953a4d998106a84d247f0063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Creating volume ba5da05f-46c1-4839-9b45-5c62bb98203d {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:47 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:47 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d 1073741824 Nov 03 20:37:47 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:47 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d 1073741824" returned: 0 in 0.413s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:47 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d Nov 03 20:37:47 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:48 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d" returned: 0 in 0.240s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Attempting download of 82b2f310-b2ab-4d6d-9d32-5c0ace417816 ((None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}])) to volume ba5da05f-46c1-4839-9b45-5c62bb98203d. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[143f6024-ecb3-4329-8718-91749daeb77d]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_ngtbvqlb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:48 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_ngtbvqlb Nov 03 20:37:48 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:48 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_ngtbvqlb" returned: 0 in 0.311s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_ngtbvqlb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:48 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_ngtbvqlb Nov 03 20:37:48 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:48 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_ngtbvqlb" returned: 1 in 0.307s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82b2f310-b2ab-4d6d-9d32-5c0ace417816_ngtbvqlb' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eded2a4e-07f1-42d0-b08e-8f9706d83f0d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:48 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD Nov 03 20:37:48 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:49 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:49 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] 82b2f310-b2ab-4d6d-9d32-5c0ace417816 was qcow2, converting to qcow2 {{(pid=87342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:37:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:49 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d Nov 03 20:37:49 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:50 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d" returned: 0 in 1.662s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:50 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_82b2f310-b2ab-4d6d-9d32-5c0ace417816_yursmor0devstack@QuobyteHD, size 112.00 MB, duration 1.66 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:37:50 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Converted 112.00 MB image at 67.35 MB/s Nov 03 20:37:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:50 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d 1G Nov 03 20:37:50 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:51 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d 1G" returned: 0 in 0.301s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:51 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Downloaded image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 ((None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}])) to volume ba5da05f-46c1-4839-9b45-5c62bb98203d successfully. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:37:51 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Temporary image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 for user 7b64afaf953a4d998106a84d247f0063 is deleted. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:37:51 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Marking volume ba5da05f-46c1-4839-9b45-5c62bb98203d as bootable. {{(pid=87342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:37:51 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Copying metadata from image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 to ba5da05f-46c1-4839-9b45-5c62bb98203d. {{(pid=87342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:37:51 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Creating volume glance metadata for volume ba5da05f-46c1-4839-9b45-5c62bb98203d backed by image 82b2f310-b2ab-4d6d-9d32-5c0ace417816 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:37:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3c3867-1c3c-4f74-8185-bf129cfcfd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba5da05f-46c1-4839-9b45-5c62bb98203d', 'volume_size': 1, 'image_id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a1d5b5b8fb584c2baa8cebd79c8440cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82b2f310-b2ab-4d6d-9d32-5c0ace417816', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82b2f310-b2ab-4d6d-9d32-5c0ace417816/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bf14a6-14c4-4fd9-a159-d434312b9794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:51 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Volume volume-ba5da05f-46c1-4839-9b45-5c62bb98203d (ba5da05f-46c1-4839-9b45-5c62bb98203d): created successfully Nov 03 20:37:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bf14a6-14c4-4fd9-a159-d434312b9794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Flow 'volume_create_manager' (1875c940-7bf3-4a70-a314-c6d5028fcd33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-98dac3be-2f78-4f79-a276-f61ca5f4c63d tempest-TestShelveInstance-1916880309 None] Created volume successfully. Nov 03 20:37:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-98f6dfe2-319a-40d4-9f5c-fabcb9263aa4 req-dabc1f89-baa6-47e8-96bf-6dc8ba0f389f tempest-TestShelveInstance-1916880309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-98f6dfe2-319a-40d4-9f5c-fabcb9263aa4 req-dabc1f89-baa6-47e8-96bf-6dc8ba0f389f tempest-TestShelveInstance-1916880309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-98f6dfe2-319a-40d4-9f5c-fabcb9263aa4 req-dabc1f89-baa6-47e8-96bf-6dc8ba0f389f tempest-TestShelveInstance-1916880309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:54 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-98f6dfe2-319a-40d4-9f5c-fabcb9263aa4 req-dabc1f89-baa6-47e8-96bf-6dc8ba0f389f tempest-TestShelveInstance-1916880309 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-ba5da05f-46c1-4839-9b45-5c62bb98203d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c69a681e-8509-4807-b6f1-8a4af6223d0f', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:37:54 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-98f6dfe2-319a-40d4-9f5c-fabcb9263aa4 req-dabc1f89-baa6-47e8-96bf-6dc8ba0f389f tempest-TestShelveInstance-1916880309 None] attachment_update completed successfully. Nov 03 20:38:04 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=18,cinder:UPDATE=8,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:38:04 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5,cinder:INSERT=7 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:38:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:38:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:23 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:38:23 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:23 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.273s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:38:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:38:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:38:24 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-259c71e0-0a59-49c5-8f5b-97a7ce4721f9 req-4bf4cea5-2917-43b3-9351-e09c5d86ed5f tempest-TestShelveInstance-1916880309 None] Terminate volume connection completed successfully. Nov 03 20:38:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-259c71e0-0a59-49c5-8f5b-97a7ce4721f9 req-4bf4cea5-2917-43b3-9351-e09c5d86ed5f tempest-TestShelveInstance-1916880309 None] Deleting attachment c69a681e-8509-4807-b6f1-8a4af6223d0f. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:38:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-9330c3d3-2122-421c-8342-c871c4cbe0f4 req-bc1bbdfd-617f-4d2e-8145-844e902d424f tempest-TestShelveInstance-1916880309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-9330c3d3-2122-421c-8342-c871c4cbe0f4 req-bc1bbdfd-617f-4d2e-8145-844e902d424f tempest-TestShelveInstance-1916880309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-9330c3d3-2122-421c-8342-c871c4cbe0f4 req-bc1bbdfd-617f-4d2e-8145-844e902d424f tempest-TestShelveInstance-1916880309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-9330c3d3-2122-421c-8342-c871c4cbe0f4 req-bc1bbdfd-617f-4d2e-8145-844e902d424f tempest-TestShelveInstance-1916880309 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb', 'name': 'volume-ba5da05f-46c1-4839-9b45-5c62bb98203d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea7e83fe-421e-4391-bf15-00af29256143', 'enforce_multipath': True} {{(pid=87342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:38:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-9330c3d3-2122-421c-8342-c871c4cbe0f4 req-bc1bbdfd-617f-4d2e-8145-844e902d424f tempest-TestShelveInstance-1916880309 None] attachment_update completed successfully. Nov 03 20:38:35 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:38:35 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:38:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-a166c53f-1d27-429a-82da-ec1a633da772 tempest-TestShelveInstance-1916880309 None] Terminate volume connection completed successfully. Nov 03 20:38:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-a166c53f-1d27-429a-82da-ec1a633da772 tempest-TestShelveInstance-1916880309 None] Deleting attachment ea7e83fe-421e-4391-bf15-00af29256143. {{(pid=87342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Acquiring lock "cinder-ba5da05f-46c1-4839-9b45-5c62bb98203d-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Lock "cinder-ba5da05f-46c1-4839-9b45-5c62bb98203d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Acquiring lock "cinder-quobyte-ba5da05f-46c1-4839-9b45-5c62bb98203d" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Lock "cinder-quobyte-ba5da05f-46c1-4839-9b45-5c62bb98203d" acquired by "delete_volume" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24913fc-62e2-4c2c-9af2-3098a68c5533]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:52 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d Nov 03 20:38:52 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:52 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d" returned: 0 in 0.396s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:52 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d Nov 03 20:38:52 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:52 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ba5da05f-46c1-4839-9b45-5c62bb98203d" returned: 0 in 0.247s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Lock "cinder-quobyte-ba5da05f-46c1-4839-9b45-5c62bb98203d" released by "delete_volume" :: held 0.689s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG cinder.quota [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Created reservations ['56b4f1f0-42c1-410d-a973-aec81b1b93da', '43a04a27-90d6-42f5-8242-89ba24e7a200', 'c479551f-9f8b-4e31-b6f1-0fe26e209f28', '6374d0cc-972f-4a20-b71b-09e6cd969a1f'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:53 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:38:53 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:53 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:53 devstack cinder-volume[87342]: DEBUG cinder.manager [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:53 devstack cinder-volume[87342]: INFO cinder.volume.manager [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Deleted volume successfully. Nov 03 20:38:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [req-34df0aa9-547c-4930-b9e8-3ea5c3ca569b req-2efbb127-0cc5-43b0-8db1-376acce4263c tempest-TestShelveInstance-1916880309 None] Lock "cinder-ba5da05f-46c1-4839-9b45-5c62bb98203d-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:39:02 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:39:03 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Flow 'volume_create_manager' (000738ad-a279-4207-a5f6-2833466b72e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d026fa-583b-47ab-8d2c-4c2376934b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d026fa-583b-47ab-8d2c-4c2376934b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1375753718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2995b41-17a6-4979-b0c1-d7de591c2e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13e16c9a60b4236934c6616c4ae940d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:39:22Z,use_quota=True,user_id='ebf8ae68b0ee4a04bfb568f7981fb24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bee670-2881-4681-881b-4a76e8c8368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bee670-2881-4681-881b-4a76e8c8368a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1b20b3-3353-4cdf-8ea8-a2bcdc89139f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1b20b3-3353-4cdf-8ea8-a2bcdc89139f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2995b41-17a6-4979-b0c1-d7de591c2e02', 'volume_name': 'volume-a2995b41-17a6-4979-b0c1-d7de591c2e02', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc585225-5bd1-40d4-8825-f81a0a544771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc585225-5bd1-40d4-8825-f81a0a544771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab8832f-8f4d-4828-85c1-9e325689bbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:22 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Volume a2995b41-17a6-4979-b0c1-d7de591c2e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2995b41-17a6-4979-b0c1-d7de591c2e02', 'volume_size': 1} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1375753718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2995b41-17a6-4979-b0c1-d7de591c2e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13e16c9a60b4236934c6616c4ae940d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:39:22Z,use_quota=True,user_id='ebf8ae68b0ee4a04bfb568f7981fb24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Creating volume a2995b41-17a6-4979-b0c1-d7de591c2e02 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:39:22 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:22 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 1073741824 Nov 03 20:39:22 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:22 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 1073741824" returned: 0 in 0.395s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:22 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 Nov 03 20:39:22 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:22 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02" returned: 0 in 0.238s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab8832f-8f4d-4828-85c1-9e325689bbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2995b41-17a6-4979-b0c1-d7de591c2e02', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98dc2a5-769b-4550-9c87-81caf719ea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:22 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Volume volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 (a2995b41-17a6-4979-b0c1-d7de591c2e02): created successfully Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98dc2a5-769b-4550-9c87-81caf719ea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Flow 'volume_create_manager' (000738ad-a279-4207-a5f6-2833466b72e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:39:22 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-21a2919d-4650-4d4a-9dee-4da6d1ed8073 tempest-TestImageHashVerification-63945545 None] Created volume successfully. Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:23 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:39:23 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:23 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.268s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[908f86f1-83da-4e31-b3c6-4741f2a4c022]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:39:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:24 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 Nov 03 20:39:24 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:24 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02" returned: 0 in 0.358s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:24 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[900bd157-910f-4fca-8a4e-3afb5c893a59]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:39:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:24 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 Nov 03 20:39:24 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:24 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02" returned: 0 in 0.352s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 /opt/stack/data/cinder/conversion/a2995b41-17a6-4979-b0c1-d7de591c2e02.temp_image.357bcf5c-fe79-4d3d-9cae-a0050f0ecdd3c4dt_lgy.img {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:24 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 /opt/stack/data/cinder/conversion/a2995b41-17a6-4979-b0c1-d7de591c2e02.temp_image.357bcf5c-fe79-4d3d-9cae-a0050f0ecdd3c4dt_lgy.img Nov 03 20:39:24 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:30 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 /opt/stack/data/cinder/conversion/a2995b41-17a6-4979-b0c1-d7de591c2e02.temp_image.357bcf5c-fe79-4d3d-9cae-a0050f0ecdd3c4dt_lgy.img" returned: 0 in 5.639s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:30 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d0c886-dd63-407e-a726-3a5a506b3547]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:39:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:30 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 Nov 03 20:39:30 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:30 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02" returned: 0 in 0.536s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:30 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/conversion/a2995b41-17a6-4979-b0c1-d7de591c2e02.temp_image.357bcf5c-fe79-4d3d-9cae-a0050f0ecdd3c4dt_lgy.img {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:39:30 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] Converted 1024.00 MB image at 181.55 MB/s Nov 03 20:39:30 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] 357bcf5c-fe79-4d3d-9cae-a0050f0ecdd3 was raw, no need to convert to raw {{(pid=87342) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 20:39:40 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:39:40 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:39:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.421s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] Uploaded volume to glance image-id: 357bcf5c-fe79-4d3d-9cae-a0050f0ecdd3. {{(pid=87342) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 20:39:49 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-1e70bea3-4b7a-4ed8-a9c2-34206560f97b tempest-TestImageHashVerification-63945545 None] Copy volume to image completed successfully. Nov 03 20:39:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Acquiring lock "cinder-a2995b41-17a6-4979-b0c1-d7de591c2e02-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:39:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Lock "cinder-a2995b41-17a6-4979-b0c1-d7de591c2e02-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:39:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Acquiring lock "cinder-quobyte-a2995b41-17a6-4979-b0c1-d7de591c2e02" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:39:50 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Lock "cinder-quobyte-a2995b41-17a6-4979-b0c1-d7de591c2e02" acquired by "delete_volume" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:39:50 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe1108f-1bee-4a8a-b798-8a50048f885c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:39:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:50 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 Nov 03 20:39:50 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:50 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02" returned: 0 in 0.353s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:50 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02 Nov 03 20:39:50 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:51 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a2995b41-17a6-4979-b0c1-d7de591c2e02" returned: 0 in 0.244s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Lock "cinder-quobyte-a2995b41-17a6-4979-b0c1-d7de591c2e02" released by "delete_volume" :: held 0.637s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Created reservations ['a917a3f8-78c0-4c69-bba3-0bbc18d5f6c2', 'ddf18954-af10-4332-80de-fdf9ebf28e64', 'a697e2fd-ae35-4534-8f4a-05323c5b84be', 'ff864bc6-d807-4243-bb22-fed52eb815fb'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:51 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:39:51 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:51 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.238s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:39:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Deleted volume successfully. Nov 03 20:39:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2ad9df10-3288-4067-bfd7-bae0787f12ba tempest-TestImageHashVerification-63945545 None] Lock "cinder-a2995b41-17a6-4979-b0c1-d7de591c2e02-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:01 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:40:01 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=9,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Flow 'volume_create_manager' (178d55b1-9f13-4caa-923a-fd3897dad1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31460201-85d6-4b23-911b-da71c3e9faff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31460201-85d6-4b23-911b-da71c3e9faff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1635242751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194a294f-0168-412f-bf8c-ce466b8ae71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7844621b9b0d434ebf8e6aba8bc8587f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:40:07Z,use_quota=True,user_id='8c0ecc570dcb45788d586a78ed4ad918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a781f0-41c4-4ef1-8c6e-d662ba8e5de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a781f0-41c4-4ef1-8c6e-d662ba8e5de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55815f9b-8dae-46b0-b787-988d7d7b7c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55815f9b-8dae-46b0-b787-988d7d7b7c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194a294f-0168-412f-bf8c-ce466b8ae71a', 'volume_name': 'volume-194a294f-0168-412f-bf8c-ce466b8ae71a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37aea7b-36ec-46fe-9c35-19a7b1582bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37aea7b-36ec-46fe-9c35-19a7b1582bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c47b9c8-ba45-482a-98c2-63887ab48e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:07 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Volume 194a294f-0168-412f-bf8c-ce466b8ae71a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194a294f-0168-412f-bf8c-ce466b8ae71a', 'volume_size': 1} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1635242751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194a294f-0168-412f-bf8c-ce466b8ae71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7844621b9b0d434ebf8e6aba8bc8587f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:40:07Z,use_quota=True,user_id='8c0ecc570dcb45788d586a78ed4ad918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Creating volume 194a294f-0168-412f-bf8c-ce466b8ae71a {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:40:07 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:07 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a 1073741824 Nov 03 20:40:07 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:07 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a 1073741824" returned: 0 in 0.408s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:07 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a Nov 03 20:40:07 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:07 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c47b9c8-ba45-482a-98c2-63887ab48e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194a294f-0168-412f-bf8c-ce466b8ae71a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d574db55-ad15-4137-b2b4-deb06227cfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:07 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Volume volume-194a294f-0168-412f-bf8c-ce466b8ae71a (194a294f-0168-412f-bf8c-ce466b8ae71a): created successfully Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d574db55-ad15-4137-b2b4-deb06227cfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Flow 'volume_create_manager' (178d55b1-9f13-4caa-923a-fd3897dad1c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:07 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-34cb2802-1e74-413e-8f4b-f4d5b924eee7 tempest-ProjectReaderTests-1208671873 None] Created volume successfully. Nov 03 20:40:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Acquiring lock "cinder-194a294f-0168-412f-bf8c-ce466b8ae71a-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Lock "cinder-194a294f-0168-412f-bf8c-ce466b8ae71a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Acquiring lock "cinder-quobyte-194a294f-0168-412f-bf8c-ce466b8ae71a" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Lock "cinder-quobyte-194a294f-0168-412f-bf8c-ce466b8ae71a" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:08 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[46628ab8-bfea-4060-9565-b6502add520c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:40:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:08 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a Nov 03 20:40:08 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:08 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a" returned: 0 in 0.360s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:08 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a Nov 03 20:40:08 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:08 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-194a294f-0168-412f-bf8c-ce466b8ae71a" returned: 0 in 0.236s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Lock "cinder-quobyte-194a294f-0168-412f-bf8c-ce466b8ae71a" released by "delete_volume" :: held 0.638s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Created reservations ['a8dda4e8-f77c-4c88-a06b-000ade34cc41', 'ef7ffaf7-cf3f-45f5-8940-7d5648d00614', 'd869b6cf-b457-4a4a-ad8f-db7d9257f56d', '34e3e9e7-3eda-4b33-ae07-5b6df81fa4ea'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:09 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:40:09 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:09 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.274s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:40:09 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Deleted volume successfully. Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d4ff728c-d542-42e7-9646-d1df0c55a7dc tempest-ProjectReaderTests-1208671873 None] Lock "cinder-194a294f-0168-412f-bf8c-ce466b8ae71a-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Flow 'volume_create_manager' (aff5cdb5-2f83-47bd-af17-8a69a6e6fcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fc5b11-c7dc-48b6-b1df-65d0bca469d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fc5b11-c7dc-48b6-b1df-65d0bca469d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43479352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0026b4-f3c6-4989-b8b0-d5ad42847669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7844621b9b0d434ebf8e6aba8bc8587f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:40:10Z,use_quota=True,user_id='8c0ecc570dcb45788d586a78ed4ad918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47a3705-4411-4e86-9077-469c6f7919fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47a3705-4411-4e86-9077-469c6f7919fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc581dc-ba27-40e6-a742-633717b806ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc581dc-ba27-40e6-a742-633717b806ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e0026b4-f3c6-4989-b8b0-d5ad42847669', 'volume_name': 'volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123d53fb-697e-4252-ba1c-bad0c228b91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123d53fb-697e-4252-ba1c-bad0c228b91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b30759-44d4-4816-914a-75ae14fd22f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:09 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Volume 4e0026b4-f3c6-4989-b8b0-d5ad42847669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669', 'volume_size': 1} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43479352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0026b4-f3c6-4989-b8b0-d5ad42847669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7844621b9b0d434ebf8e6aba8bc8587f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:40:10Z,use_quota=True,user_id='8c0ecc570dcb45788d586a78ed4ad918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Creating volume 4e0026b4-f3c6-4989-b8b0-d5ad42847669 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:40:09 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:40:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:09 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669 1073741824 Nov 03 20:40:09 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:10 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669 1073741824" returned: 0 in 0.428s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:10 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669 Nov 03 20:40:10 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:10 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669" returned: 0 in 0.244s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b30759-44d4-4816-914a-75ae14fd22f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64c55a0-a3b4-4d93-9a7f-e1087c143c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:10 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Volume volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669 (4e0026b4-f3c6-4989-b8b0-d5ad42847669): created successfully Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64c55a0-a3b4-4d93-9a7f-e1087c143c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Flow 'volume_create_manager' (aff5cdb5-2f83-47bd-af17-8a69a6e6fcfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ab4e0122-6207-4b1c-af74-6307a55fbdd3 tempest-ProjectReaderTests-1208671873 None] Created volume successfully. Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Acquiring lock "cinder-4e0026b4-f3c6-4989-b8b0-d5ad42847669-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Lock "cinder-4e0026b4-f3c6-4989-b8b0-d5ad42847669-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Acquiring lock "cinder-quobyte-4e0026b4-f3c6-4989-b8b0-d5ad42847669" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Lock "cinder-quobyte-4e0026b4-f3c6-4989-b8b0-d5ad42847669" acquired by "delete_volume" :: waited 0.012s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdb60cb-23e7-431e-955a-7d371e1eb7d7]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:40:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:11 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669 Nov 03 20:40:11 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:11 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669" returned: 0 in 0.357s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:11 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669 Nov 03 20:40:11 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:11 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e0026b4-f3c6-4989-b8b0-d5ad42847669" returned: 0 in 0.234s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Lock "cinder-quobyte-4e0026b4-f3c6-4989-b8b0-d5ad42847669" released by "delete_volume" :: held 0.629s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Created reservations ['379e64a7-0c8e-4a57-abb2-7274aa817cde', '69516bea-b2bd-42e9-af66-14c05fbbfb09', 'b0fc5844-00b4-40e3-a278-2d75b3225a8f', 'cf5105a5-35ad-492b-ab4a-db81bcdf27eb'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:11 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:40:11 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:11 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.244s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:40:11 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Deleted volume successfully. Nov 03 20:40:11 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4e81e16e-5e4e-47d1-8305-3b9ac3aaf90b tempest-ProjectReaderTests-1208671873 None] Lock "cinder-4e0026b4-f3c6-4989-b8b0-d5ad42847669-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Flow 'volume_create_manager' (eb2e3187-0a0e-488b-8b4d-587d7d1d0629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3f04e7-74c0-40ca-9c36-8b191e811fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3f04e7-74c0-40ca-9c36-8b191e811fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1506919880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671739be-0523-4c82-8a07-b1da7ebc0142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7844621b9b0d434ebf8e6aba8bc8587f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:40:12Z,use_quota=True,user_id='8c0ecc570dcb45788d586a78ed4ad918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5301b1ba-025f-444b-876f-62cdab6813d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5301b1ba-025f-444b-876f-62cdab6813d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2036dd23-1999-4d1f-8a2b-99fb0b27913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2036dd23-1999-4d1f-8a2b-99fb0b27913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '671739be-0523-4c82-8a07-b1da7ebc0142', 'volume_name': 'volume-671739be-0523-4c82-8a07-b1da7ebc0142', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4453919-5cd0-4cc8-9207-89d317d36a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4453919-5cd0-4cc8-9207-89d317d36a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb248b7a-3c24-41f1-9aca-0047d2e22358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:12 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Volume 671739be-0523-4c82-8a07-b1da7ebc0142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-671739be-0523-4c82-8a07-b1da7ebc0142', 'volume_size': 1} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1506919880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671739be-0523-4c82-8a07-b1da7ebc0142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7844621b9b0d434ebf8e6aba8bc8587f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:40:12Z,use_quota=True,user_id='8c0ecc570dcb45788d586a78ed4ad918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Creating volume 671739be-0523-4c82-8a07-b1da7ebc0142 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:40:12 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:12 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142 1073741824 Nov 03 20:40:12 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:12 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142 1073741824" returned: 0 in 0.390s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:12 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142 Nov 03 20:40:12 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:13 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142" returned: 0 in 0.241s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb248b7a-3c24-41f1-9aca-0047d2e22358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671739be-0523-4c82-8a07-b1da7ebc0142', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93017e23-52e8-49bd-a822-83e53c42334f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:13 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Volume volume-671739be-0523-4c82-8a07-b1da7ebc0142 (671739be-0523-4c82-8a07-b1da7ebc0142): created successfully Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93017e23-52e8-49bd-a822-83e53c42334f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Flow 'volume_create_manager' (eb2e3187-0a0e-488b-8b4d-587d7d1d0629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:13 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7a7441aa-e0f4-4801-8e43-3bb9891c4be6 tempest-ProjectReaderTests-1208671873 None] Created volume successfully. Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Acquiring lock "cinder-671739be-0523-4c82-8a07-b1da7ebc0142-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Lock "cinder-671739be-0523-4c82-8a07-b1da7ebc0142-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Acquiring lock "cinder-quobyte-671739be-0523-4c82-8a07-b1da7ebc0142" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Lock "cinder-quobyte-671739be-0523-4c82-8a07-b1da7ebc0142" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afa1634-ee32-4265-8263-3bb6f26e8d18]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:13 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142 Nov 03 20:40:13 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:13 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142" returned: 0 in 0.358s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:13 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142 Nov 03 20:40:13 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:14 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-671739be-0523-4c82-8a07-b1da7ebc0142" returned: 0 in 0.233s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Lock "cinder-quobyte-671739be-0523-4c82-8a07-b1da7ebc0142" released by "delete_volume" :: held 0.629s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Created reservations ['b244ec40-c64d-40eb-b0e0-7b4823a40cf5', '8c1c3f37-982d-4404-99e3-f3fc26a1455d', '836783d1-6dcc-4cb3-800f-b0b7c0149c4c', 'fb52d8b8-9adb-4950-a7e1-4e9faa7e2c50'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:14 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:40:14 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:14 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.237s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:40:14 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Deleted volume successfully. Nov 03 20:40:14 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f83cb60f-a861-4781-b48b-9df48f4babd8 tempest-ProjectReaderTests-1208671873 None] Lock "cinder-671739be-0523-4c82-8a07-b1da7ebc0142-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Flow 'volume_create_manager' (ffd904cc-efcf-45c0-bce1-f818a0013b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c48b71e-27d3-42fa-b5f3-1c31668a696e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c48b71e-27d3-42fa-b5f3-1c31668a696e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278186923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1b25f3-4ba0-4430-b4cf-949602ebcc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7844621b9b0d434ebf8e6aba8bc8587f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:40:15Z,use_quota=True,user_id='8c0ecc570dcb45788d586a78ed4ad918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35030b90-e9f9-4339-b4e7-14388dc9f007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35030b90-e9f9-4339-b4e7-14388dc9f007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4edeaa-ab98-4495-b831-09824d42fd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4edeaa-ab98-4495-b831-09824d42fd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1b25f3-4ba0-4430-b4cf-949602ebcc5c', 'volume_name': 'volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87dbfc3-92bc-4018-b20b-e7bd4ead061a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87dbfc3-92bc-4018-b20b-e7bd4ead061a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4a3f2d-fa88-4b6f-8c12-c879fe87f90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:15 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Volume ae1b25f3-4ba0-4430-b4cf-949602ebcc5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c', 'volume_size': 1} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278186923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1b25f3-4ba0-4430-b4cf-949602ebcc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7844621b9b0d434ebf8e6aba8bc8587f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:40:15Z,use_quota=True,user_id='8c0ecc570dcb45788d586a78ed4ad918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Creating volume ae1b25f3-4ba0-4430-b4cf-949602ebcc5c {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:40:15 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:15 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c 1073741824 Nov 03 20:40:15 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:15 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c 1073741824" returned: 0 in 0.391s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:15 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c Nov 03 20:40:15 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:15 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c" returned: 0 in 0.241s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4a3f2d-fa88-4b6f-8c12-c879fe87f90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a3f1b8-14ac-47b3-b9c5-55d96ceb9697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:15 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Volume volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c (ae1b25f3-4ba0-4430-b4cf-949602ebcc5c): created successfully Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a3f1b8-14ac-47b3-b9c5-55d96ceb9697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Flow 'volume_create_manager' (ffd904cc-efcf-45c0-bce1-f818a0013b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:15 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4d8a155c-0f1d-49fe-b7b8-98521ad6b922 tempest-ProjectReaderTests-1208671873 None] Created volume successfully. Nov 03 20:40:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Acquiring lock "cinder-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Lock "cinder-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Acquiring lock "cinder-quobyte-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Lock "cinder-quobyte-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:16 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db07fa5-c21b-4c54-af68-eb61f2e01fe2]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:40:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:16 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c Nov 03 20:40:16 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:16 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c" returned: 0 in 0.383s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:16 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c Nov 03 20:40:16 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:16 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c" returned: 0 in 0.236s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Lock "cinder-quobyte-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c" released by "delete_volume" :: held 0.659s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:17 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Created reservations ['4c623b40-5988-4000-989b-c081fcae6c50', 'd375fee8-4505-4e26-9ffd-3cdbd488a69b', 'f1820d5d-0418-45d5-89d3-b02e42f73c3d', '02d2d6f3-873f-42af-a242-dc7a708c1b09'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:40:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:17 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:40:17 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:17 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.245s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:17 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:40:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Deleted volume successfully. Nov 03 20:40:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-9e7554c3-c723-4a58-9d8b-cfcfa272539a tempest-ProjectReaderTests-1208671873 None] Lock "cinder-ae1b25f3-4ba0-4430-b4cf-949602ebcc5c-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:40:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:23 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:40:23 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:24 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.313s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:40:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:40:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:40:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:40:27 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=27,cinder:UPDATE=41,cinder:INSERT=12,cinder:DELETE=6 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:40:27 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=47,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Flow 'volume_create_manager' (dd9e720b-f386-41af-b524-f700034a291f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70515073-ad3e-469e-8c24-3d0e31a6c489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70515073-ad3e-469e-8c24-3d0e31a6c489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-650928490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67c66f4-c1ca-4860-ba24-a62ce45d93f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5008096ce0400283162391c7c83887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:40:38Z,use_quota=True,user_id='cfd71b92ca6f4478ae04755fef53295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fac977-5e6f-480b-b5e0-7eae1f2f6882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fac977-5e6f-480b-b5e0-7eae1f2f6882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1472d88-fde5-4eb5-b486-cd56bdbc70e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1472d88-fde5-4eb5-b486-cd56bdbc70e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd67c66f4-c1ca-4860-ba24-a62ce45d93f9', 'volume_name': 'volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f31d567-2f1b-4589-bf7d-50e9f795c742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f31d567-2f1b-4589-bf7d-50e9f795c742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3242336-3169-4283-acc7-90f545019dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:38 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Volume d67c66f4-c1ca-4860-ba24-a62ce45d93f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9', 'volume_size': 1} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-650928490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67c66f4-c1ca-4860-ba24-a62ce45d93f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5008096ce0400283162391c7c83887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:40:38Z,use_quota=True,user_id='cfd71b92ca6f4478ae04755fef53295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Creating volume d67c66f4-c1ca-4860-ba24-a62ce45d93f9 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:40:38 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:38 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 1073741824 Nov 03 20:40:38 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:38 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 1073741824" returned: 0 in 0.401s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:39 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 Nov 03 20:40:39 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:39 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" returned: 0 in 0.241s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3242336-3169-4283-acc7-90f545019dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1083f16e-db8a-4f70-9e85-ffbaaf8468c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:39 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Volume volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 (d67c66f4-c1ca-4860-ba24-a62ce45d93f9): created successfully Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1083f16e-db8a-4f70-9e85-ffbaaf8468c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Flow 'volume_create_manager' (dd9e720b-f386-41af-b524-f700034a291f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4374ec42-54b4-4978-89fd-f360faf9c2ff tempest-SnapshotDependencyTests-1212027951 None] Created volume successfully. Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] Creating offline snapshot fb8e0781-9116-46e3-8f55-11542fcf116f of volume d67c66f4-c1ca-4860-ba24-a62ce45d93f9 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea957e05-7a4b-447f-9909-184fbdcf12f4]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:40:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:39 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 Nov 03 20:40:39 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:40 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" returned: 0 in 0.353s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:40 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f 1G Nov 03 20:40:40 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:40 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f 1G" returned: 0 in 0.372s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:40 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f Nov 03 20:40:40 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:40 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f" returned: 0 in 0.282s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:40 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f is being set with open permissions: ugo+rw Nov 03 20:40:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:40 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f Nov 03 20:40:40 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:41 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f" returned: 0 in 0.237s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:41 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.info Nov 03 20:40:41 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:41 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.info" returned: 0 in 0.243s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:41 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.info is being set with open permissions: ugo+rw Nov 03 20:40:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:41 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.info Nov 03 20:40:41 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:41 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.info" returned: 0 in 0.238s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:41 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b750f2d8-6c3f-4807-acd1-ee74b03ea234 tempest-SnapshotDependencyTests-1212027951 None] Create snapshot completed successfully Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Flow 'volume_create_manager' (4d84d453-b57f-4cc6-a13d-4bd2553cf0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9ff8c1-3cde-4d27-878b-0e28ff5b1003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9ff8c1-3cde-4d27-878b-0e28ff5b1003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee261a87-8d71-46e8-9389-2fcf6cda3c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5008096ce0400283162391c7c83887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fb8e0781-9116-46e3-8f55-11542fcf116f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:40:42Z,use_quota=True,user_id='cfd71b92ca6f4478ae04755fef53295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65678f99-0888-4993-a2b4-db1526c45441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65678f99-0888-4993-a2b4-db1526c45441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac9122d-d639-4dcf-bf8b-09b099e46bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac9122d-d639-4dcf-bf8b-09b099e46bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee261a87-8d71-46e8-9389-2fcf6cda3c14', 'volume_name': 'volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14', 'volume_size': 1, 'snapshot_id': 'fb8e0781-9116-46e3-8f55-11542fcf116f'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7da2688-77c8-45e3-b0c0-b27b9c3d7e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7da2688-77c8-45e3-b0c0-b27b9c3d7e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e0c7af-73df-4a3a-84fc-692e5f2df655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:42 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Volume ee261a87-8d71-46e8-9389-2fcf6cda3c14: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14', 'volume_size': 1, 'snapshot_id': 'fb8e0781-9116-46e3-8f55-11542fcf116f'} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "cinder-quobyte-fb8e0781-9116-46e3-8f55-11542fcf116f-ee261a87-8d71-46e8-9389-2fcf6cda3c14" by "_create_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-fb8e0781-9116-46e3-8f55-11542fcf116f-ee261a87-8d71-46e8-9389-2fcf6cda3c14" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Creating volume ee261a87-8d71-46e8-9389-2fcf6cda3c14 from snapshot fb8e0781-9116-46e3-8f55-11542fcf116f {{(pid=87342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "cinder-quobyte-ee261a87-8d71-46e8-9389-2fcf6cda3c14" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-ee261a87-8d71-46e8-9389-2fcf6cda3c14" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] snapshot: fb8e0781-9116-46e3-8f55-11542fcf116f, volume: ee261a87-8d71-46e8-9389-2fcf6cda3c14, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cad001-37f2-48c2-bb2c-667a5b5f331e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:42 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f Nov 03 20:40:42 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:42 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f" returned: 0 in 0.351s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8970c4-66cb-4be7-ba4a-f9fac313f958]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:40:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:42 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 Nov 03 20:40:42 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:43 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" returned: 0 in 0.354s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:40:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:40:43 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:40:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:43 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 Nov 03 20:40:43 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:49 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14" returned: 0 in 5.818s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:40:49 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Converted 1024.00 MB image at 175.94 MB/s Nov 03 20:40:49 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 is being set with open permissions: ugo+rw Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:49 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 Nov 03 20:40:49 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:49 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14" returned: 0 in 0.243s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-ee261a87-8d71-46e8-9389-2fcf6cda3c14" released by "_copy_volume_from_snapshot" :: held 6.846s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-fb8e0781-9116-46e3-8f55-11542fcf116f-ee261a87-8d71-46e8-9389-2fcf6cda3c14" released by "_create_volume_from_snapshot" :: held 6.903s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.918s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e0c7af-73df-4a3a-84fc-692e5f2df655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14', 'volume_size': 1, 'snapshot_id': 'fb8e0781-9116-46e3-8f55-11542fcf116f'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6c4783-4c13-4adf-b60b-23a164abf6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:40:49 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Volume volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 (ee261a87-8d71-46e8-9389-2fcf6cda3c14): created successfully Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6c4783-4c13-4adf-b60b-23a164abf6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Flow 'volume_create_manager' (4d84d453-b57f-4cc6-a13d-4bd2553cf0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:40:49 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2c08eb27-c5e4-4967-9a70-e940025bc539 tempest-SnapshotDependencyTests-1212027951 None] Created volume successfully. Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "cinder-fb8e0781-9116-46e3-8f55-11542fcf116f-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-fb8e0781-9116-46e3-8f55-11542fcf116f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "cinder-quobyte-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "cinder-quobyte-fb8e0781-9116-46e3-8f55-11542fcf116f" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-fb8e0781-9116-46e3-8f55-11542fcf116f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Deleting offline snapshot fb8e0781-9116-46e3-8f55-11542fcf116f of volume d67c66f4-c1ca-4860-ba24-a62ce45d93f9 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:40:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] snapshot_file for this snap is: volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:40:50 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd8208e-4fd0-4f22-87bb-09fee5bd0b26]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:40:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:50 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f Nov 03 20:40:50 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:50 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f" returned: 0 in 0.357s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:40:50 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb364284-149c-4643-a83f-ef679ec51263]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:40:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:50 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 Nov 03 20:40:50 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:50 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" returned: 0 in 0.527s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:50 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f Nov 03 20:40:50 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:51 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f" returned: 0 in 0.328s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:51 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f Nov 03 20:40:51 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:51 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9.fb8e0781-9116-46e3-8f55-11542fcf116f" returned: 0 in 0.252s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-fb8e0781-9116-46e3-8f55-11542fcf116f" released by "_delete_snapshot" :: held 1.564s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" released by "delete_snapshot" :: held 1.585s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:51 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Created reservations ['f834b18c-efc4-451e-8cb4-e2bddb832acb', '29149229-1bbb-4f8b-b577-012af593f811', 'd154a5e0-114d-4d32-a833-0cb158b9abbe', '7e9bd9e6-6e05-4ba8-8052-4faf9ed25d0b'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:40:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Delete snapshot completed successfully. Nov 03 20:40:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-14eb23f3-caa6-4ca6-9191-60d20421fdcd tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-fb8e0781-9116-46e3-8f55-11542fcf116f-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "cinder-d67c66f4-c1ca-4860-ba24-a62ce45d93f9-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-d67c66f4-c1ca-4860-ba24-a62ce45d93f9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "cinder-quobyte-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0072ed3-8be5-47c4-9b47-6da867cef1ba]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:52 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 Nov 03 20:40:52 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:52 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" returned: 0 in 0.361s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:52 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9 Nov 03 20:40:52 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:52 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" returned: 0 in 0.239s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-d67c66f4-c1ca-4860-ba24-a62ce45d93f9" released by "delete_volume" :: held 0.661s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Created reservations ['ff226ffd-1316-4ccc-9bf7-0e8896c5ef4f', '8f83d7f4-855a-4315-9bd6-31a11331e1af', '062e4b42-9f21-4f9f-969a-7077d1974e7a', 'a7cbb382-ec8f-453e-93c7-9ee9c9f78e6f'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:52 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:40:52 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:53 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.243s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:40:53 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Deleted volume successfully. Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3d9c52e5-a319-4606-8384-3ce0fa3ecc43 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-d67c66f4-c1ca-4860-ba24-a62ce45d93f9-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "cinder-ee261a87-8d71-46e8-9389-2fcf6cda3c14-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-ee261a87-8d71-46e8-9389-2fcf6cda3c14-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "cinder-quobyte-ee261a87-8d71-46e8-9389-2fcf6cda3c14" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-ee261a87-8d71-46e8-9389-2fcf6cda3c14" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2716dbc6-1357-4c4b-acc4-5b24a06310a5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:53 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 Nov 03 20:40:53 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:53 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14" returned: 0 in 0.357s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:53 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14 Nov 03 20:40:53 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:53 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ee261a87-8d71-46e8-9389-2fcf6cda3c14" returned: 0 in 0.248s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-quobyte-ee261a87-8d71-46e8-9389-2fcf6cda3c14" released by "delete_volume" :: held 0.646s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:40:53 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Created reservations ['59b27abb-c651-4f4c-8585-0766c154b23d', 'f9603867-b7d0-4e8c-b26b-d2a835272cfb', '4655ab9d-7893-4d4c-b366-32c8205a00ca', 'bbe75440-c0a4-4394-9fd5-4dfcf5ee4b17'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:40:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:40:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:40:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:40:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:40:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:40:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:40:54 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:40:54 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:40:54 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Nov 03 20:40:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.239s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:40:54 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:40:54 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Deleted volume successfully. Nov 03 20:40:54 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-3f2f9d02-00bf-4620-9558-29bae0e91221 tempest-SnapshotDependencyTests-1212027951 None] Lock "cinder-ee261a87-8d71-46e8-9389-2fcf6cda3c14-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:04 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=28,cinder:SELECT=24,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:41:04 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=25,cinder:INSERT=11,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Flow 'volume_create_manager' (34430510-dccb-4d4c-ae30-b5f693641a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dab49e-eff3-4c44-ab33-329bda0a4980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dab49e-eff3-4c44-ab33-329bda0a4980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-60585552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d29d5cd-19d7-43f7-91a0-5de351ae7ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573a4006da244c5fb0946202237311fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:14Z,use_quota=True,user_id='1677387fb1244d46ba53239cdba88e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc261827-6942-47b6-a4d8-80c93b1f7039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc261827-6942-47b6-a4d8-80c93b1f7039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ac9bab-9c14-4fe5-9932-3219efd0b60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ac9bab-9c14-4fe5-9932-3219efd0b60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d29d5cd-19d7-43f7-91a0-5de351ae7ed0', 'volume_name': 'volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22c5736-634d-487c-bbbe-212825911e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22c5736-634d-487c-bbbe-212825911e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd56854-a4cf-4626-acc7-dede399005bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Volume 8d29d5cd-19d7-43f7-91a0-5de351ae7ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0', 'volume_size': 1} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-60585552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d29d5cd-19d7-43f7-91a0-5de351ae7ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573a4006da244c5fb0946202237311fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:14Z,use_quota=True,user_id='1677387fb1244d46ba53239cdba88e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Creating volume 8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:14 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:14 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 1073741824 Nov 03 20:41:14 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Flow 'volume_create_manager' (b62dabe1-a843-466a-b75e-7f643e09a09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e4e7c4-09f9-4c16-b57c-7553724e4add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e4e7c4-09f9-4c16-b57c-7553724e4add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-501043874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee9306f-e540-460d-a2ee-dd0fd0af942b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe139262ab4f9685b5aa00afa6e880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:14Z,use_quota=True,user_id='8a93e3854df7410c9bc99eb23557ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66093f99-09a3-4762-b722-7d3b8537bd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66093f99-09a3-4762-b722-7d3b8537bd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456f4391-0382-48cb-ba33-0075b25b58c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456f4391-0382-48cb-ba33-0075b25b58c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ee9306f-e540-460d-a2ee-dd0fd0af942b', 'volume_name': 'volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dde7bac-7cf1-4bff-bd3d-a43895f37942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dde7bac-7cf1-4bff-bd3d-a43895f37942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92fbb20c-d41e-4e0f-beda-74eee5091ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Volume 3ee9306f-e540-460d-a2ee-dd0fd0af942b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b', 'volume_size': 1} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Flow 'volume_create_manager' (49a7fbfd-c257-44a0-ac2b-edef58590132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e265df07-3de9-46e4-85de-5e0da46fe2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e265df07-3de9-46e4-85de-5e0da46fe2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-888008214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d9f8db-911f-4100-aa8b-b7082b1f9878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe139262ab4f9685b5aa00afa6e880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:15Z,use_quota=True,user_id='8a93e3854df7410c9bc99eb23557ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c88b039-5cd4-4623-9ebb-db553567078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c88b039-5cd4-4623-9ebb-db553567078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2cf5644-dff9-441d-94ac-f2d2a8f9b8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2cf5644-dff9-441d-94ac-f2d2a8f9b8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d9f8db-911f-4100-aa8b-b7082b1f9878', 'volume_name': 'volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80f8132-4aa7-4b7d-b7b7-d495e6b80ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80f8132-4aa7-4b7d-b7b7-d495e6b80ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9544087-c171-43d9-a2af-500ae1ae3ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:14 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Volume f5d9f8db-911f-4100-aa8b-b7082b1f9878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878', 'volume_size': 1} Nov 03 20:41:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (9cb6b143-ba61-43ae-b23b-a9ae1b81a3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d18bcb2-2181-4bb5-90a5-7296046b4cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d18bcb2-2181-4bb5-90a5-7296046b4cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1081150299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf87975-62ac-4807-9832-676485933cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:15Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14279d96-3fd0-4d18-b303-0a147b4109a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14279d96-3fd0-4d18-b303-0a147b4109a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221a6afc-0d90-4625-b8c0-a27a441a2bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221a6afc-0d90-4625-b8c0-a27a441a2bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf87975-62ac-4807-9832-676485933cbe', 'volume_name': 'volume-faf87975-62ac-4807-9832-676485933cbe', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b94b9e-a43c-4a42-a460-3f08d8e3c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b94b9e-a43c-4a42-a460-3f08d8e3c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0ec361-a036-42ab-a377-0736c68c4bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume faf87975-62ac-4807-9832-676485933cbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf87975-62ac-4807-9832-676485933cbe', 'volume_size': 1} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:15 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 1073741824" returned: 0 in 0.735s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:15 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 Nov 03 20:41:15 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Flow 'volume_create_manager' (c0fb12e6-776e-456a-9b2d-4ffb65564c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b6b9ca-a7cb-46dd-8850-407d3bd731b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b6b9ca-a7cb-46dd-8850-407d3bd731b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-479700545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d328858-314c-4560-8fd0-55b0da6d8078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe139262ab4f9685b5aa00afa6e880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:15Z,use_quota=True,user_id='8a93e3854df7410c9bc99eb23557ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785f590a-8a58-4f8f-b2ac-cf8d7b03203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785f590a-8a58-4f8f-b2ac-cf8d7b03203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2c48d1-6ea3-494f-9718-2b976dfdff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2c48d1-6ea3-494f-9718-2b976dfdff9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d328858-314c-4560-8fd0-55b0da6d8078', 'volume_name': 'volume-2d328858-314c-4560-8fd0-55b0da6d8078', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc14c7c6-0fe3-45f4-a3a3-7b8ff0a4d5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc14c7c6-0fe3-45f4-a3a3-7b8ff0a4d5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd74257-a7a5-4e7e-a240-30347cbe7a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Volume 2d328858-314c-4560-8fd0-55b0da6d8078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d328858-314c-4560-8fd0-55b0da6d8078', 'volume_size': 1} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:15 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Flow 'volume_create_manager' (59cb6660-0b8a-4a0a-8a7a-8a5551409f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b6ba8e-3409-431f-b9f0-0234b45ed7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" returned: 0 in 0.359s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.947s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-501043874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee9306f-e540-460d-a2ee-dd0fd0af942b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe139262ab4f9685b5aa00afa6e880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:14Z,use_quota=True,user_id='8a93e3854df7410c9bc99eb23557ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Creating volume 3ee9306f-e540-460d-a2ee-dd0fd0af942b {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:15 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:15 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b 1073741824 Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b6ba8e-3409-431f-b9f0-0234b45ed7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1600324315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe139262ab4f9685b5aa00afa6e880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:16Z,use_quota=True,user_id='8a93e3854df7410c9bc99eb23557ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497dc652-4a6c-471a-81ea-e15ed747949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497dc652-4a6c-471a-81ea-e15ed747949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d316fdbc-bec5-4337-8b6d-e8fc6c66ee77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d316fdbc-bec5-4337-8b6d-e8fc6c66ee77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9', 'volume_name': 'volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952bb01f-34f9-448b-9139-3b7405c45864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952bb01f-34f9-448b-9139-3b7405c45864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b351ff-5854-4f2d-add8-6359bde38af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Volume ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9', 'volume_size': 1} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd56854-a4cf-4626-acc7-dede399005bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ce7ebc-b3a5-4f62-9a77-b39a9d8aec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:15 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Volume volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 (8d29d5cd-19d7-43f7-91a0-5de351ae7ed0): created successfully Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ce7ebc-b3a5-4f62-9a77-b39a9d8aec5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Flow 'volume_create_manager' (34430510-dccb-4d4c-ae30-b5f693641a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:15 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-72619b1f-0f24-4ceb-a088-456c5fa8d6ef tempest-VolumeDependencyTests-1931646048 None] Created volume successfully. Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Flow 'volume_create_manager' (552514cc-26a5-46a2-be17-797c94668b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613ce167-93db-4d1a-9ff7-08486e8fc862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613ce167-93db-4d1a-9ff7-08486e8fc862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-726276668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ad3eba-80fc-4b10-aba3-1f30f3f83781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe139262ab4f9685b5aa00afa6e880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:16Z,use_quota=True,user_id='8a93e3854df7410c9bc99eb23557ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a57856-2ef6-4845-9f53-c8a38b79c219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a57856-2ef6-4845-9f53-c8a38b79c219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b76841-a308-4b31-a0f1-79dcf8008b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b76841-a308-4b31-a0f1-79dcf8008b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ad3eba-80fc-4b10-aba3-1f30f3f83781', 'volume_name': 'volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8437abac-bd42-4d8d-8fa7-ec3ee1942f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8437abac-bd42-4d8d-8fa7-ec3ee1942f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7bbce6-666c-4560-90d5-cc6521d704cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:16 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Volume 57ad3eba-80fc-4b10-aba3-1f30f3f83781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781', 'volume_size': 1} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:16 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b 1073741824" returned: 0 in 0.599s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:16 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b Nov 03 20:41:16 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:16 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b" returned: 0 in 0.279s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.702s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-888008214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d9f8db-911f-4100-aa8b-b7082b1f9878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe139262ab4f9685b5aa00afa6e880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:15Z,use_quota=True,user_id='8a93e3854df7410c9bc99eb23557ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Creating volume f5d9f8db-911f-4100-aa8b-b7082b1f9878 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:16 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:16 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878 1073741824 Nov 03 20:41:16 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92fbb20c-d41e-4e0f-beda-74eee5091ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac17d97d-7096-47ec-b9b0-6c1ff8976f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:16 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Volume volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b (3ee9306f-e540-460d-a2ee-dd0fd0af942b): created successfully Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac17d97d-7096-47ec-b9b0-6c1ff8976f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Flow 'volume_create_manager' (b62dabe1-a843-466a-b75e-7f643e09a09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:16 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-90a60c87-f8a8-4b7c-9f57-84798cd7e290 tempest-CreateVolumesFromImageTest-752034847 None] Created volume successfully. Nov 03 20:41:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:17 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878 1073741824" returned: 0 in 0.496s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:17 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878 Nov 03 20:41:17 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:17 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878" returned: 0 in 0.246s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.165s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1081150299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf87975-62ac-4807-9832-676485933cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:15Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Creating volume faf87975-62ac-4807-9832-676485933cbe {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:17 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9544087-c171-43d9-a2af-500ae1ae3ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec0966b-98e5-46cb-8303-d9febd7d84de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:17 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe 1073741824 Nov 03 20:41:17 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:17 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Volume volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878 (f5d9f8db-911f-4100-aa8b-b7082b1f9878): created successfully Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec0966b-98e5-46cb-8303-d9febd7d84de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Flow 'volume_create_manager' (49a7fbfd-c257-44a0-ac2b-edef58590132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f6973d3f-9df2-45cd-bb4e-9e304e434062 tempest-CreateVolumesFromImageTest-752034847 None] Created volume successfully. Nov 03 20:41:17 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe 1073741824" returned: 0 in 0.474s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:18 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe Nov 03 20:41:18 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:18 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe" returned: 0 in 0.278s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.760s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-479700545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d328858-314c-4560-8fd0-55b0da6d8078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe139262ab4f9685b5aa00afa6e880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:15Z,use_quota=True,user_id='8a93e3854df7410c9bc99eb23557ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Creating volume 2d328858-314c-4560-8fd0-55b0da6d8078 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:18 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0ec361-a036-42ab-a377-0736c68c4bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf87975-62ac-4807-9832-676485933cbe', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f1a4c7-98aa-4c62-8403-77f50eedb9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:18 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078 1073741824 Nov 03 20:41:18 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:18 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume volume-faf87975-62ac-4807-9832-676485933cbe (faf87975-62ac-4807-9832-676485933cbe): created successfully Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f1a4c7-98aa-4c62-8403-77f50eedb9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (9cb6b143-ba61-43ae-b23b-a9ae1b81a3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:18 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8f24a93f-2641-44b1-9831-2ca7fbba3f49 tempest-CreateVolumesFromSnapshotTest-740141342 None] Created volume successfully. Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Flow 'volume_create_manager' (983d3074-8fe1-433b-b23c-60f10535f4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d1cb1c-1ad6-4554-93b3-229c3ab390a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d1cb1c-1ad6-4554-93b3-229c3ab390a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbef863-708f-42bb-a3d0-bc58f78905f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84677097103c4ced95720cdb4063e753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:18Z,use_quota=True,user_id='a65d86ca894b45c18c2d715d4a9185db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93942f54-dac0-4027-b206-e753b9c07c01),volume_type_id=93942f54-dac0-4027-b206-e753b9c07c01)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799f717a-86ec-4fe2-8c0a-db997a7c2c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799f717a-86ec-4fe2-8c0a-db997a7c2c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3dfc78f-c2ea-437a-9b4e-c3b35b13c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.image.glance [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Creating Keystone auth plugin from conf {{(pid=87342) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:41:18 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078 1073741824" returned: 0 in 0.494s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3dfc78f-c2ea-437a-9b4e-c3b35b13c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bdbef863-708f-42bb-a3d0-bc58f78905f5', 'volume_name': 'volume-bdbef863-708f-42bb-a3d0-bc58f78905f5', 'volume_size': 1, 'image_id': '7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2339a512e887974e6f919201443280f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '84677097103c4ced95720cdb4063e753', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79aceefa790af098717c598713a049237202bcc4361dcf503c17734d37e51f8e0414a00c5840942b21790c428088bf269c7dd81e9ee2cb0ba2c95085245b5e16', 'id': '7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'created_at': datetime.datetime(2026, 11, 3, 19, 41, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 41, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7838e72c-315f-4c1b-b4e9-e1535cdb24f5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469c6ac3-3395-453f-a331-087e38bb9660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469c6ac3-3395-453f-a331-087e38bb9660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc37a38-7936-4f55-a969-8a916e55fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:18 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Volume bdbef863-708f-42bb-a3d0-bc58f78905f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bdbef863-708f-42bb-a3d0-bc58f78905f5', 'volume_size': 1, 'image_id': '7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2339a512e887974e6f919201443280f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '84677097103c4ced95720cdb4063e753', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79aceefa790af098717c598713a049237202bcc4361dcf503c17734d37e51f8e0414a00c5840942b21790c428088bf269c7dd81e9ee2cb0ba2c95085245b5e16', 'id': '7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'created_at': datetime.datetime(2026, 11, 3, 19, 41, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 41, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7838e72c-315f-4c1b-b4e9-e1535cdb24f5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Trying to clone bdbef863-708f-42bb-a3d0-bc58f78905f5 from image 7838e72c-315f-4c1b-b4e9-e1535cdb24f5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'metadata': {}}]). {{(pid=87342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:18 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078 Nov 03 20:41:18 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:41:18 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Image download 0.00 MB at 0.00 MB/s Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a18f345-0f33-4488-a2fb-b968d497fb65]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:19 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD Nov 03 20:41:19 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:19 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078" returned: 0 in 0.310s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.335s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1600324315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe139262ab4f9685b5aa00afa6e880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:16Z,use_quota=True,user_id='8a93e3854df7410c9bc99eb23557ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Creating volume ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:19 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:19 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9 1073741824 Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd74257-a7a5-4e7e-a240-30347cbe7a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d328858-314c-4560-8fd0-55b0da6d8078', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:19 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2289eb0b-f90f-41a6-ac2d-68bdefe3254c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:19 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Volume volume-2d328858-314c-4560-8fd0-55b0da6d8078 (2d328858-314c-4560-8fd0-55b0da6d8078): created successfully Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2289eb0b-f90f-41a6-ac2d-68bdefe3254c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Flow 'volume_create_manager' (c0fb12e6-776e-456a-9b2d-4ffb65564c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:19 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-24bb3592-7277-4881-835b-d40d502ad027 tempest-CreateVolumesFromImageTest-752034847 None] Created volume successfully. Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:19 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:19 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD Nov 03 20:41:19 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:19 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9 1073741824" returned: 0 in 0.480s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:19 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9 Nov 03 20:41:19 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:19 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Temporary image 7838e72c-315f-4c1b-b4e9-e1535cdb24f5 is fetched for user a65d86ca894b45c18c2d715d4a9185db. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f5f4bf-d3cd-4df4-9195-b76169f0bda7]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:19 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9" returned: 0 in 0.277s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:19 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD Nov 03 20:41:19 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.794s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-726276668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ad3eba-80fc-4b10-aba3-1f30f3f83781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe139262ab4f9685b5aa00afa6e880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:16Z,use_quota=True,user_id='8a93e3854df7410c9bc99eb23557ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Creating volume 57ad3eba-80fc-4b10-aba3-1f30f3f83781 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:19 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:19 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b351ff-5854-4f2d-add8-6359bde38af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abff9705-db7b-4617-ae47-27e8669dc936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:20 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781 1073741824 Nov 03 20:41:20 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:20 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Volume volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9 (ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9): created successfully Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abff9705-db7b-4617-ae47-27e8669dc936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Flow 'volume_create_manager' (59cb6660-0b8a-4a0a-8a7a-8a5551409f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:20 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-57dcb1db-a81e-4d1f-ae85-f8f389a60c55 tempest-CreateVolumesFromImageTest-752034847 None] Created volume successfully. Nov 03 20:41:20 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:20 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD Nov 03 20:41:20 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:20 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781 1073741824" returned: 0 in 0.461s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:20 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781 Nov 03 20:41:20 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:20 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:20 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781" returned: 0 in 0.254s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.927s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7bbce6-666c-4560-90d5-cc6521d704cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cd7186-6ecd-4b6e-8bb4-59515ce4cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] Creating offline snapshot 52a5954a-473a-435e-b67b-ccb0163c7a4f of volume 8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:41:20 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Volume volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781 (57ad3eba-80fc-4b10-aba3-1f30f3f83781): created successfully Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cd7186-6ecd-4b6e-8bb4-59515ce4cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Flow 'volume_create_manager' (552514cc-26a5-46a2-be17-797c94668b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dc4065-df4f-4be6-96f5-5ed743773b35]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:20 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-085eae2b-2f33-40db-85da-404a96a62c1f tempest-CreateVolumesFromImageTest-752034847 None] Created volume successfully. Nov 03 20:41:20 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 Nov 03 20:41:20 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:21 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" returned: 0 in 0.354s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:21 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f 1G Nov 03 20:41:21 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:21 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f 1G" returned: 0 in 0.391s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:21 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f Nov 03 20:41:21 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "cinder-57ad3eba-80fc-4b10-aba3-1f30f3f83781-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-57ad3eba-80fc-4b10-aba3-1f30f3f83781-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "cinder-quobyte-57ad3eba-80fc-4b10-aba3-1f30f3f83781" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-quobyte-57ad3eba-80fc-4b10-aba3-1f30f3f83781" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f574ae11-4f15-42ba-b131-b68d6fbfc123]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:21 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f" returned: 0 in 0.303s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:21 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f is being set with open permissions: ugo+rw Nov 03 20:41:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:21 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f Nov 03 20:41:21 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:21 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781 Nov 03 20:41:21 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:22 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f" returned: 0 in 0.245s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:22 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.info Nov 03 20:41:22 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:22 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781" returned: 0 in 0.378s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:22 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781 Nov 03 20:41:22 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:22 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.info" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:22 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.info is being set with open permissions: ugo+rw Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:22 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.info Nov 03 20:41:22 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:22 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-57ad3eba-80fc-4b10-aba3-1f30f3f83781" returned: 0 in 0.259s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-quobyte-57ad3eba-80fc-4b10-aba3-1f30f3f83781" released by "delete_volume" :: held 0.681s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Created reservations ['8d8a032e-4c03-4cc6-9294-d2bc1f7e509c', '0f10f62f-e82f-471e-91fb-2b7bf77c4786', '13b36045-c094-4ae6-bbdb-43d4f97bbd0d', 'dd31d8b1-7182-45a1-b20b-27c21794103a'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:22 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:22 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:22 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.info" returned: 0 in 0.279s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.276s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] Creating offline snapshot 5318f7cb-a707-43c0-8d4b-4f3d1ece444f of volume faf87975-62ac-4807-9832-676485933cbe {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:41:22 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-86956f38-8590-4d67-ac5c-11fc74750e02 tempest-VolumeDependencyTests-1931646048 None] Create snapshot completed successfully Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75a0a88-cfff-4590-8858-924b0ccb056d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:22 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.264s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:22 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe Nov 03 20:41:22 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:22 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Deleted volume successfully. Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "cinder-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a2408323-d7e3-49fd-bfe2-cea7c30470ee tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-57ad3eba-80fc-4b10-aba3-1f30f3f83781-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "cinder-quobyte-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-quobyte-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12dfeeb-1de5-461b-8b09-c62bcd1ad732]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:23 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:23 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9 Nov 03 20:41:23 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe" returned: 0 in 0.412s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:23 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f 1G Nov 03 20:41:23 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:23 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9" returned: 0 in 0.408s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:23 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9 Nov 03 20:41:23 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:23 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f 1G" returned: 0 in 0.532s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf87975-62ac-4807-9832-676485933cbe -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:23 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf87975-62ac-4807-9832-676485933cbe -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Flow 'volume_create_manager' (3bf56403-2c3d-46c4-a08a-7c176134e175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:23 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:23 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55853d7-38b3-4a0a-93c0-04e2f65aa7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9" returned: 0 in 0.330s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:23 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:23 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55853d7-38b3-4a0a-93c0-04e2f65aa7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1766447488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce645c1-020e-478d-9167-766b73045168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573a4006da244c5fb0946202237311fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52a5954a-473a-435e-b67b-ccb0163c7a4f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:24Z,use_quota=True,user_id='1677387fb1244d46ba53239cdba88e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f11330-88c6-4190-9ee7-ee40ce595865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f11330-88c6-4190-9ee7-ee40ce595865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f640a62-5ca7-4d93-af1a-1d5963b6787a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f640a62-5ca7-4d93-af1a-1d5963b6787a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1ce645c1-020e-478d-9167-766b73045168', 'volume_name': 'volume-1ce645c1-020e-478d-9167-766b73045168', 'volume_size': 1, 'snapshot_id': '52a5954a-473a-435e-b67b-ccb0163c7a4f'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf3d411-c5e7-4bb5-ad4a-4fdb71822c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf3d411-c5e7-4bb5-ad4a-4fdb71822c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6206bb-39f1-461f-ba00-ede5fb30f861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:23 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Volume 1ce645c1-020e-478d-9167-766b73045168: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1ce645c1-020e-478d-9167-766b73045168', 'volume_size': 1, 'snapshot_id': '52a5954a-473a-435e-b67b-ccb0163c7a4f'} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-quobyte-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9" released by "delete_volume" :: held 0.846s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Created reservations ['9c161b57-12c5-41e7-bc9e-242775375754', '08d9eeb5-0ff7-47cc-b4ba-be8140377829', '53b48c41-df9b-4b17-9de8-21cf65540b0a', 'b6168360-454d-49ff-8ff9-1f009f8a1d8c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:23 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:23 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:24 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf87975-62ac-4807-9832-676485933cbe -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f" returned: 0 in 0.347s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:24 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f is being set with open permissions: ugo+rw Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:24 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.307s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:41:24 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f Nov 03 20:41:24 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "cinder-2d328858-314c-4560-8fd0-55b0da6d8078-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-2d328858-314c-4560-8fd0-55b0da6d8078-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "cinder-quobyte-2d328858-314c-4560-8fd0-55b0da6d8078" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-quobyte-2d328858-314c-4560-8fd0-55b0da6d8078" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace73b30-93d7-4fba-9285-b8e91807dbbd]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:24 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.298s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:24 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Deleted volume successfully. Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee12b443-a341-4d4e-9c25-ab19c85de044 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-ed7f6add-26ff-4fff-b8f5-a59a9f6e52b9-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:24 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f" returned: 0 in 0.314s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:24 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078 Nov 03 20:41:24 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:24 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.info Nov 03 20:41:24 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:24 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078" returned: 0 in 0.381s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:24 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.info" returned: 0 in 0.267s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:24 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.info is being set with open permissions: ugo+rw Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:24 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078 Nov 03 20:41:24 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:24 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.info Nov 03 20:41:24 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:24 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2d328858-314c-4560-8fd0-55b0da6d8078" returned: 0 in 0.241s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-quobyte-2d328858-314c-4560-8fd0-55b0da6d8078" released by "delete_volume" :: held 0.684s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:24 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.info" returned: 0 in 0.260s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.230s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.385s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbef863-708f-42bb-a3d0-bc58f78905f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84677097103c4ced95720cdb4063e753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:18Z,use_quota=True,user_id='a65d86ca894b45c18c2d715d4a9185db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93942f54-dac0-4027-b206-e753b9c07c01),volume_type_id=93942f54-dac0-4027-b206-e753b9c07c01)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Creating volume bdbef863-708f-42bb-a3d0-bc58f78905f5 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:24 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:24 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 1073741824 Nov 03 20:41:24 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:24 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-59650f54-7f30-4a9e-932c-265044da0cc7 tempest-CreateVolumesFromSnapshotTest-740141342 None] Create snapshot completed successfully Nov 03 20:41:24 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Created reservations ['bf0a2cb4-974f-4689-9a42-9707c77b8000', '7bf5d4f9-6db9-4c4e-a4cc-1d32a4eb70ec', '345afb51-493c-4407-89e6-b71476553985', '1cff4df9-dd9c-4c21-bc6c-383e25bfc5ec'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:25 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:25 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "cinder-f5d9f8db-911f-4100-aa8b-b7082b1f9878-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-f5d9f8db-911f-4100-aa8b-b7082b1f9878-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "cinder-quobyte-f5d9f8db-911f-4100-aa8b-b7082b1f9878" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-quobyte-f5d9f8db-911f-4100-aa8b-b7082b1f9878" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:25 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.308s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Deleted volume successfully. Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[175d17a7-46c9-4e43-80de-1194fc3b2e18]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-adbf3c1e-d987-47e7-a416-45d7cd5ac6a3 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-2d328858-314c-4560-8fd0-55b0da6d8078-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:25 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 1073741824" returned: 0 in 0.542s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:25 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 Nov 03 20:41:25 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:25 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878 Nov 03 20:41:25 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:25 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5" returned: 0 in 0.284s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.966s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "cinder-quobyte-52a5954a-473a-435e-b67b-ccb0163c7a4f-1ce645c1-020e-478d-9167-766b73045168" by "_create_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-52a5954a-473a-435e-b67b-ccb0163c7a4f-1ce645c1-020e-478d-9167-766b73045168" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Creating volume 1ce645c1-020e-478d-9167-766b73045168 from snapshot 52a5954a-473a-435e-b67b-ccb0163c7a4f {{(pid=87342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "cinder-quobyte-1ce645c1-020e-478d-9167-766b73045168" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:25 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Attempting download of 7838e72c-315f-4c1b-b4e9-e1535cdb24f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'metadata': {}}])) to volume bdbef863-708f-42bb-a3d0-bc58f78905f5. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878" returned: 0 in 0.426s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-1ce645c1-020e-478d-9167-766b73045168" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] snapshot: 52a5954a-473a-435e-b67b-ccb0163c7a4f, volume: 1ce645c1-020e-478d-9167-766b73045168, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:41:25 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878 Nov 03 20:41:25 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c4426a-2a6a-4579-8a3d-6749f49d9550]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_274jlbay {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[68adb934-28db-45ef-bafa-9b4af1482ec9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:26 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f Nov 03 20:41:26 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:26 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_274jlbay Nov 03 20:41:26 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:26 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f5d9f8db-911f-4100-aa8b-b7082b1f9878" returned: 0 in 0.364s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-quobyte-f5d9f8db-911f-4100-aa8b-b7082b1f9878" released by "delete_volume" :: held 0.842s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (190328e2-0a86-4ccd-b9c6-a66e444a5831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c212905-c191-48eb-a1e3-a4d039cd859e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c212905-c191-48eb-a1e3-a4d039cd859e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1908165890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12fa093-516f-4bb2-9b42-b2eb08c9ff02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:26Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75f944b-9cce-4788-ba82-373d0a414533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75f944b-9cce-4788-ba82-373d0a414533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e220420-9b50-40ea-b941-7e5bcd810fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e220420-9b50-40ea-b941-7e5bcd810fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12fa093-516f-4bb2-9b42-b2eb08c9ff02', 'volume_name': 'volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4531546-5f82-4628-be8f-3c0485f35cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4531546-5f82-4628-be8f-3c0485f35cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fded62a3-915d-40ae-b171-3c3708184f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:26 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume a12fa093-516f-4bb2-9b42-b2eb08c9ff02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02', 'volume_size': 1} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Created reservations ['52689d9e-f5c2-4c74-876a-d9e69c41c5b7', '80f5c404-0422-4210-bc23-f3ea63e3820f', '8b60472a-8f1d-477b-89f5-f30502d67e99', '6fcf8472-23dd-41a9-bfc6-ef83df529499'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:26 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f" returned: 0 in 0.481s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d499b26f-d56d-429a-9290-faa01ea3d994]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:26 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_274jlbay" returned: 0 in 0.541s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_274jlbay {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:26 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:26 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:26 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_274jlbay Nov 03 20:41:26 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:26 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 Nov 03 20:41:26 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (e6e70cdc-bde3-4eac-a1e5-9b881c4c327d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488e61ec-9ad0-4171-9e64-47831adbb444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488e61ec-9ad0-4171-9e64-47831adbb444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-415669846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0584b9-ddc1-441b-b358-49701eaa6a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:27Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3667b1-0b66-4fdf-85c2-d147b8b0ab79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3667b1-0b66-4fdf-85c2-d147b8b0ab79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bc31e5-ecc5-43ef-98b3-a9ca215c038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bc31e5-ecc5-43ef-98b3-a9ca215c038e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0584b9-ddc1-441b-b358-49701eaa6a19', 'volume_name': 'volume-af0584b9-ddc1-441b-b358-49701eaa6a19', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57647e5-9366-400e-b297-e2ae9bf232ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57647e5-9366-400e-b297-e2ae9bf232ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f62cf5-79be-4489-aa7b-15fe8d8e9ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:26 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume af0584b9-ddc1-441b-b358-49701eaa6a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0584b9-ddc1-441b-b358-49701eaa6a19', 'volume_size': 1} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:26 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.428s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:26 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:26 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Deleted volume successfully. Nov 03 20:41:27 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" returned: 0 in 0.550s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168 not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:27 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_274jlbay" returned: 1 in 0.543s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_274jlbay' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d759029a-80a8-4ac3-aee7-15188d8fb985]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:27 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168 Nov 03 20:41:27 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:27 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD Nov 03 20:41:27 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-acad8bc3-a722-4fa4-afc9-714e0df47a7f tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-f5d9f8db-911f-4100-aa8b-b7082b1f9878-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:27 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:27 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD Nov 03 20:41:27 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (f09b789e-895b-4365-a582-2937e603c66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78468621-7271-442e-ac38-b38e95afd842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "cinder-3ee9306f-e540-460d-a2ee-dd0fd0af942b-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78468621-7271-442e-ac38-b38e95afd842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721861268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cd2fc0-b077-4652-aa47-0cc7cd4090ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:27Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:27 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880b5a35-4ae8-46b3-95fb-ebbf3cb7f2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880b5a35-4ae8-46b3-95fb-ebbf3cb7f2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f437e67c-02c0-4ae7-a595-c6ed7a2c1946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f437e67c-02c0-4ae7-a595-c6ed7a2c1946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7cd2fc0-b077-4652-aa47-0cc7cd4090ca', 'volume_name': 'volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c419703f-36bf-45d6-9568-880c77dc1720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c419703f-36bf-45d6-9568-880c77dc1720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3d95f8-cb66-4e2e-b9a8-8cd4758f2785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:27 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume b7cd2fc0-b077-4652-aa47-0cc7cd4090ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca', 'volume_size': 1} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-3ee9306f-e540-460d-a2ee-dd0fd0af942b-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD" returned: 1 in 0.618s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:41:27 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] 7838e72c-315f-4c1b-b4e9-e1535cdb24f5 was raw, converting to qcow2 {{(pid=87342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:41:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:28 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 Nov 03 20:41:28 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "cinder-quobyte-3ee9306f-e540-460d-a2ee-dd0fd0af942b" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-quobyte-3ee9306f-e540-460d-a2ee-dd0fd0af942b" acquired by "delete_volume" :: waited 0.062s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:28 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a7de14-392d-4608-b7fa-d3048c89ffee]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:28 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b Nov 03 20:41:28 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:28 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (364a5eb8-3ab2-4f98-984b-f2da6b1f4ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c48cae-a5c0-4a15-8d3f-db24f708c4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c48cae-a5c0-4a15-8d3f-db24f708c4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1555972285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76688e3-6636-41a9-8e34-309aef73d872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:29Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c344f0-c262-402e-9c29-1ec6674f805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c344f0-c262-402e-9c29-1ec6674f805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad401de4-4665-4299-ac90-0e139f8b2df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad401de4-4665-4299-ac90-0e139f8b2df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76688e3-6636-41a9-8e34-309aef73d872', 'volume_name': 'volume-b76688e3-6636-41a9-8e34-309aef73d872', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811e9b2b-591c-47f4-a7dc-32420d548ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811e9b2b-591c-47f4-a7dc-32420d548ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16da84b-e460-4681-a58d-03d4a0989416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:29 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume b76688e3-6636-41a9-8e34-309aef73d872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76688e3-6636-41a9-8e34-309aef73d872', 'volume_size': 1} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:29 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b" returned: 0 in 0.957s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:29 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b Nov 03 20:41:29 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:29 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5" returned: 0 in 1.470s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7838e72c-315f-4c1b-b4e9-e1535cdb24f5_fha57itxdevstack@QuobyteHD, size 0.00 MB, duration 1.47 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:41:29 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:29 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 1G Nov 03 20:41:29 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:29 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3ee9306f-e540-460d-a2ee-dd0fd0af942b" returned: 0 in 0.427s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-quobyte-3ee9306f-e540-460d-a2ee-dd0fd0af942b" released by "delete_volume" :: held 1.510s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Created reservations ['c2c1c6e4-55de-4a94-af86-0d86e65b6389', 'fb730fcb-b175-4977-b5dd-abbce567b25a', '04ede178-d848-4616-9135-91c1077f7ebc', 'd871eb7c-94ec-492f-9a07-56a12de5b36b'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:30 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 1G" returned: 0 in 0.774s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Downloaded image 7838e72c-315f-4c1b-b4e9-e1535cdb24f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'metadata': {}}])) to volume bdbef863-708f-42bb-a3d0-bc58f78905f5 successfully. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Temporary image 7838e72c-315f-4c1b-b4e9-e1535cdb24f5 for user a65d86ca894b45c18c2d715d4a9185db is deleted. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Marking volume bdbef863-708f-42bb-a3d0-bc58f78905f5 as bootable. {{(pid=87342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (69d00f2a-ffe1-457c-b191-b5ea42a456d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451f9af9-447c-4ef0-84ad-604bc264087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:30 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:30 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451f9af9-447c-4ef0-84ad-604bc264087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465112391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc90c434-ffba-4d92-b127-1a27a9bcf584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:30Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19eaee1e-f5c4-4f9d-9626-f98700c7562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19eaee1e-f5c4-4f9d-9626-f98700c7562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a286abe7-1a37-4de4-b681-9932c4117aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a286abe7-1a37-4de4-b681-9932c4117aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc90c434-ffba-4d92-b127-1a27a9bcf584', 'volume_name': 'volume-fc90c434-ffba-4d92-b127-1a27a9bcf584', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11880716-9b71-43b4-abc4-e891eee01148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11880716-9b71-43b4-abc4-e891eee01148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a25ba53-43ac-414a-8356-fd3cde51c188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:30 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume fc90c434-ffba-4d92-b127-1a27a9bcf584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc90c434-ffba-4d92-b127-1a27a9bcf584', 'volume_size': 1} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Copying metadata from image 7838e72c-315f-4c1b-b4e9-e1535cdb24f5 to bdbef863-708f-42bb-a3d0-bc58f78905f5. {{(pid=87342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Creating volume glance metadata for volume bdbef863-708f-42bb-a3d0-bc58f78905f5 backed by image 7838e72c-315f-4c1b-b4e9-e1535cdb24f5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2339a512e887974e6f919201443280f6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:41:30 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.538s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:30 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Deleted volume successfully. Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc37a38-7936-4f55-a969-8a916e55fe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdbef863-708f-42bb-a3d0-bc58f78905f5', 'volume_size': 1, 'image_id': '7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2339a512e887974e6f919201443280f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '84677097103c4ced95720cdb4063e753', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79aceefa790af098717c598713a049237202bcc4361dcf503c17734d37e51f8e0414a00c5840942b21790c428088bf269c7dd81e9ee2cb0ba2c95085245b5e16', 'id': '7838e72c-315f-4c1b-b4e9-e1535cdb24f5', 'created_at': datetime.datetime(2026, 11, 3, 19, 41, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 41, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7838e72c-315f-4c1b-b4e9-e1535cdb24f5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4f1264-c9c2-4543-abbb-3121e40886e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a015e5cf-3fed-4e16-a052-3b224b1ad335 tempest-CreateVolumesFromImageTest-752034847 None] Lock "cinder-3ee9306f-e540-460d-a2ee-dd0fd0af942b-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:31 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Volume volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 (bdbef863-708f-42bb-a3d0-bc58f78905f5): created successfully Nov 03 20:41:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4f1264-c9c2-4543-abbb-3121e40886e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Flow 'volume_create_manager' (983d3074-8fe1-433b-b23c-60f10535f4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:31 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0b0c261f-e781-482a-b504-2176694914db tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Created volume successfully. Nov 03 20:41:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Acquiring lock "cinder-bdbef863-708f-42bb-a3d0-bc58f78905f5-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Lock "cinder-bdbef863-708f-42bb-a3d0-bc58f78905f5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Acquiring lock "cinder-quobyte-bdbef863-708f-42bb-a3d0-bc58f78905f5" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Lock "cinder-quobyte-bdbef863-708f-42bb-a3d0-bc58f78905f5" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:32 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec56b706-6287-4ef1-a66c-16285553a893]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:32 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 Nov 03 20:41:32 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:33 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5" returned: 0 in 0.794s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:33 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5 Nov 03 20:41:33 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:33 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-bdbef863-708f-42bb-a3d0-bc58f78905f5" returned: 0 in 0.474s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:33 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Lock "cinder-quobyte-bdbef863-708f-42bb-a3d0-bc58f78905f5" released by "delete_volume" :: held 1.369s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:33 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Created reservations ['a3c7395c-20d2-4136-b37e-27ae0903b571', 'de2d150d-9c84-4dd7-a05f-78ceba638fd8', '97d8a2b8-7650-40c0-be0b-361c4a0aa3b4', '62d5988a-843e-486a-a3fa-a32ccf8fdf77'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:33 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:33 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:34 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.516s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:34 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:34 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Deleted volume successfully. Nov 03 20:41:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-30e08863-29be-4e0d-bdeb-e2cb7cc68f06 tempest-VolumeAndVolumeTypeFromImageTest-970637998 None] Lock "cinder-bdbef863-708f-42bb-a3d0-bc58f78905f5-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:35 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168" returned: 0 in 8.197s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0, size 1024.00 MB, duration 8.20 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:41:35 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Converted 1024.00 MB image at 124.91 MB/s Nov 03 20:41:35 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168 is being set with open permissions: ugo+rw Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:35 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168 Nov 03 20:41:35 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:35 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168" returned: 0 in 0.267s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-1ce645c1-020e-478d-9167-766b73045168" released by "_copy_volume_from_snapshot" :: held 9.634s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-52a5954a-473a-435e-b67b-ccb0163c7a4f-1ce645c1-020e-478d-9167-766b73045168" released by "_create_volume_from_snapshot" :: held 9.723s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.756s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.184s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1908165890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12fa093-516f-4bb2-9b42-b2eb08c9ff02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:26Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Creating volume a12fa093-516f-4bb2-9b42-b2eb08c9ff02 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:35 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:35 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02 1073741824 Nov 03 20:41:35 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6206bb-39f1-461f-ba00-ede5fb30f861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce645c1-020e-478d-9167-766b73045168', 'volume_size': 1, 'snapshot_id': '52a5954a-473a-435e-b67b-ccb0163c7a4f'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c566bb2e-bf51-4480-9706-ea9ce277a1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:35 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Volume volume-1ce645c1-020e-478d-9167-766b73045168 (1ce645c1-020e-478d-9167-766b73045168): created successfully Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c566bb2e-bf51-4480-9706-ea9ce277a1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Flow 'volume_create_manager' (3bf56403-2c3d-46c4-a08a-7c176134e175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-db3107fe-87ff-4734-8a7f-bb1293c9abcf tempest-VolumeDependencyTests-1931646048 None] Created volume successfully. Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "cinder-52a5954a-473a-435e-b67b-ccb0163c7a4f-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-52a5954a-473a-435e-b67b-ccb0163c7a4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "cinder-quobyte-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "cinder-quobyte-52a5954a-473a-435e-b67b-ccb0163c7a4f" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-52a5954a-473a-435e-b67b-ccb0163c7a4f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Deleting offline snapshot 52a5954a-473a-435e-b67b-ccb0163c7a4f of volume 8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] snapshot_file for this snap is: volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbd6293-7e43-43dc-8cf1-d425576f2214]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:36 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f Nov 03 20:41:36 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:36 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02 1073741824" returned: 0 in 0.552s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:36 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02 Nov 03 20:41:36 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:36 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f" returned: 0 in 0.488s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1439343f-a6e8-4d77-8268-c6ca8054fa4c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:36 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02" returned: 0 in 0.389s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.680s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-415669846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0584b9-ddc1-441b-b358-49701eaa6a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:27Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Creating volume af0584b9-ddc1-441b-b358-49701eaa6a19 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:36 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fded62a3-915d-40ae-b171-3c3708184f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:36 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19 1073741824 Nov 03 20:41:36 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86599e8b-42ae-448b-8ef3-4d3940f09e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:36 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 Nov 03 20:41:36 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02 (a12fa093-516f-4bb2-9b42-b2eb08c9ff02): created successfully Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86599e8b-42ae-448b-8ef3-4d3940f09e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (190328e2-0a86-4ccd-b9c6-a66e444a5831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:36 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ac0643c7-09e7-425e-8bb8-a01b0efbdaf6 tempest-CreateVolumesFromSnapshotTest-740141342 None] Created volume successfully. Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Flow 'volume_create_manager' (07f578c0-d10d-493f-95be-c96545574ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d24cb7-379e-46a0-8807-de40ee76e798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d24cb7-379e-46a0-8807-de40ee76e798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ae7867-0ab2-44e4-835a-309db62272f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b050e1f5b341359b526ecb41a31ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:37Z,use_quota=True,user_id='a39f309b67504268852a4a2f7d5f7337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75282182-7c12-4460-b816-946b8b5f0661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75282182-7c12-4460-b816-946b8b5f0661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb98a0b-bb91-4bef-b935-85f7425a2c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb98a0b-bb91-4bef-b935-85f7425a2c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ae7867-0ab2-44e4-835a-309db62272f6', 'volume_name': 'volume-89ae7867-0ab2-44e4-835a-309db62272f6', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc05114-f81d-4dc1-85a5-204f1be19ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc05114-f81d-4dc1-85a5-204f1be19ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd294447-e058-4d14-ae41-0e693c135bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Volume 89ae7867-0ab2-44e4-835a-309db62272f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ae7867-0ab2-44e4-835a-309db62272f6', 'volume_size': 1} Nov 03 20:41:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:37 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19 1073741824" returned: 0 in 0.591s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:37 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" returned: 0 in 0.670s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:37 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f Nov 03 20:41:37 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:37 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19 Nov 03 20:41:37 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:37 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19" returned: 0 in 0.343s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.600s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721861268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cd2fc0-b077-4652-aa47-0cc7cd4090ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:27Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Creating volume b7cd2fc0-b077-4652-aa47-0cc7cd4090ca {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:37 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:37 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f" returned: 0 in 0.439s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:37 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca 1073741824 Nov 03 20:41:37 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f62cf5-79be-4489-aa7b-15fe8d8e9ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0584b9-ddc1-441b-b358-49701eaa6a19', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c88c1b0-807e-463c-9866-0fc947543a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:37 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f Nov 03 20:41:37 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:37 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume volume-af0584b9-ddc1-441b-b358-49701eaa6a19 (af0584b9-ddc1-441b-b358-49701eaa6a19): created successfully Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c88c1b0-807e-463c-9866-0fc947543a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (e6e70cdc-bde3-4eac-a1e5-9b881c4c327d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-fa0bc370-010a-4d1a-9982-f6d9158c1d64 tempest-CreateVolumesFromSnapshotTest-740141342 None] Created volume successfully. Nov 03 20:41:37 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0.52a5954a-473a-435e-b67b-ccb0163c7a4f" returned: 0 in 0.314s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-52a5954a-473a-435e-b67b-ccb0163c7a4f" released by "_delete_snapshot" :: held 2.090s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" released by "delete_snapshot" :: held 2.115s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Created reservations ['1998ff57-8e73-4c4e-9f4e-b361fc45427e', 'deacc014-ceb0-4788-b82c-f430ee50972f', '63f75c8d-9fed-4d9c-8b48-1ce806a7b93b', 'ea006238-231f-4e85-ab98-d3bcf8e20909'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:38 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Delete snapshot completed successfully. Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-042dd072-4b15-4440-8ee4-300ea2674c90 tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-52a5954a-473a-435e-b67b-ccb0163c7a4f-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:38 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca 1073741824" returned: 0 in 0.552s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:38 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca Nov 03 20:41:38 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:38 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca" returned: 0 in 0.258s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.288s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1555972285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76688e3-6636-41a9-8e34-309aef73d872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:29Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Creating volume b76688e3-6636-41a9-8e34-309aef73d872 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:38 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3d95f8-cb66-4e2e-b9a8-8cd4758f2785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf38b11-758b-4bbc-9397-3cc67962f6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:38 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872 1073741824 Nov 03 20:41:38 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:38 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca (b7cd2fc0-b077-4652-aa47-0cc7cd4090ca): created successfully Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf38b11-758b-4bbc-9397-3cc67962f6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (f09b789e-895b-4365-a582-2937e603c66a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:38 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-823515a0-4b34-41ab-bdaf-a67239cf8ab1 tempest-CreateVolumesFromSnapshotTest-740141342 None] Created volume successfully. Nov 03 20:41:38 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872 1073741824" returned: 0 in 0.469s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:38 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872 Nov 03 20:41:38 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "cinder-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "cinder-quobyte-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b80e595-1594-414a-9e80-a1421a2196db]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:39 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872" returned: 0 in 0.322s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.724s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465112391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc90c434-ffba-4d92-b127-1a27a9bcf584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443c91b693f643a79dc4f52a38991a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:30Z,use_quota=True,user_id='5b91ca2e91ed4cd8b87986e9f9548896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Creating volume fc90c434-ffba-4d92-b127-1a27a9bcf584 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:39 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:39 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 Nov 03 20:41:39 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:39 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584 1073741824 Nov 03 20:41:39 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16da84b-e460-4681-a58d-03d4a0989416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76688e3-6636-41a9-8e34-309aef73d872', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bd4a16-a7f4-4084-b835-fef8ef380db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:39 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume volume-b76688e3-6636-41a9-8e34-309aef73d872 (b76688e3-6636-41a9-8e34-309aef73d872): created successfully Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bd4a16-a7f4-4084-b835-fef8ef380db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (364a5eb8-3ab2-4f98-984b-f2da6b1f4ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-cae458c1-9ce0-44a6-873f-e704f1fa1245 tempest-CreateVolumesFromSnapshotTest-740141342 None] Created volume successfully. Nov 03 20:41:39 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" returned: 0 in 0.405s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:39 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0 Nov 03 20:41:39 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:39 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584 1073741824" returned: 0 in 0.550s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:39 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" returned: 0 in 0.313s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:39 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584 Nov 03 20:41:39 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0" released by "delete_volume" :: held 0.792s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (ae2d8e15-135f-40ff-a63f-4d04a25931b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d42bb7-3bd4-46b5-afa7-517e74e552c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d42bb7-3bd4-46b5-afa7-517e74e552c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-278606738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba0cada-97a7-4ae6-9018-88bfd1cfe78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:40Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6bff93-6b25-4119-8b2f-8a77bec9215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6bff93-6b25-4119-8b2f-8a77bec9215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec6c9aa-b06b-40a3-b43c-54a38930af24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec6c9aa-b06b-40a3-b43c-54a38930af24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aba0cada-97a7-4ae6-9018-88bfd1cfe78d', 'volume_name': 'volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc60bb8a-c185-479d-8c1f-7b220a5e4061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc60bb8a-c185-479d-8c1f-7b220a5e4061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0236b6e5-6177-4c5e-b399-f3a46ed313a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:40 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume aba0cada-97a7-4ae6-9018-88bfd1cfe78d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d', 'volume_size': 1} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Created reservations ['3f8ea750-6eb6-4b7b-a8ea-b5021674489f', 'f15d8f27-083e-4a00-8a70-22e709877b68', 'df2c803f-12eb-4691-aa89-a7a38a2a9614', 'c2b4133e-5459-4b6b-a96d-2aa27f6dfe14'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:40 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584" returned: 0 in 0.262s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.247s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ae7867-0ab2-44e4-835a-309db62272f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b050e1f5b341359b526ecb41a31ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:37Z,use_quota=True,user_id='a39f309b67504268852a4a2f7d5f7337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Creating volume 89ae7867-0ab2-44e4-835a-309db62272f6 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:40 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:40 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:40 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a25ba53-43ac-414a-8356-fd3cde51c188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc90c434-ffba-4d92-b127-1a27a9bcf584', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb91c480-8158-4c2f-9c1e-63c44469b36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:40 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6 1073741824 Nov 03 20:41:40 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:40 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Volume volume-fc90c434-ffba-4d92-b127-1a27a9bcf584 (fc90c434-ffba-4d92-b127-1a27a9bcf584): created successfully Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb91c480-8158-4c2f-9c1e-63c44469b36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Flow 'volume_create_manager' (69d00f2a-ffe1-457c-b191-b5ea42a456d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-04214d93-0133-49c3-87ef-48c40edef6ae tempest-CreateVolumesFromSnapshotTest-740141342 None] Created volume successfully. Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "cinder-1ce645c1-020e-478d-9167-766b73045168-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-1ce645c1-020e-478d-9167-766b73045168-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "cinder-quobyte-1ce645c1-020e-478d-9167-766b73045168" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-1ce645c1-020e-478d-9167-766b73045168" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[233fe920-42e4-48e2-b7d1-a5bb1b638e22]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:40 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.298s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Deleted volume successfully. Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2c6c391a-118e-4abe-861f-3f4f137ea9ef tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-8d29d5cd-19d7-43f7-91a0-5de351ae7ed0-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:40 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168 Nov 03 20:41:40 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:40 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6 1073741824" returned: 0 in 0.547s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:40 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6 Nov 03 20:41:40 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:40 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168" returned: 0 in 0.435s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:40 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168 Nov 03 20:41:40 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-fc90c434-ffba-4d92-b127-1a27a9bcf584-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-fc90c434-ffba-4d92-b127-1a27a9bcf584-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:41 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-quobyte-fc90c434-ffba-4d92-b127-1a27a9bcf584" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6" returned: 0 in 0.322s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.056s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-278606738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba0cada-97a7-4ae6-9018-88bfd1cfe78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:40Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Creating volume aba0cada-97a7-4ae6-9018-88bfd1cfe78d {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:41 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:41 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:41 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d 1073741824 Nov 03 20:41:41 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd294447-e058-4d14-ae41-0e693c135bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ae7867-0ab2-44e4-835a-309db62272f6', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73dafcd-ae0f-4201-9941-268ba1dd21f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-1ce645c1-020e-478d-9167-766b73045168" returned: 0 in 0.311s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-fc90c434-ffba-4d92-b127-1a27a9bcf584" acquired by "delete_volume" :: waited 0.069s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-quobyte-1ce645c1-020e-478d-9167-766b73045168" released by "delete_volume" :: held 0.823s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabdc11b-5aa7-46c9-b3ed-8c98aa419e21]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:41 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Volume volume-89ae7867-0ab2-44e4-835a-309db62272f6 (89ae7867-0ab2-44e4-835a-309db62272f6): created successfully Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73dafcd-ae0f-4201-9941-268ba1dd21f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Flow 'volume_create_manager' (07f578c0-d10d-493f-95be-c96545574ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:41 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b6236133-3100-4e5b-b64a-4411307daf24 tempest-CinderUnicodeTest-776250189 None] Created volume successfully. Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Created reservations ['409a2639-06ac-4122-83c7-19ac604576b3', '58b23f54-ca51-4b93-9c04-debd85949c46', 'a8e77fd9-7f4f-4c41-a193-0bdce041a8e1', '6983fa43-6f9e-41a5-905e-9cf58ee50ffb'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:41 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584 Nov 03 20:41:41 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:41 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:41 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:41 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584" returned: 0 in 0.443s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:41 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d 1073741824" returned: 0 in 0.549s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:41 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584 Nov 03 20:41:41 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:41 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.327s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:41 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Deleted volume successfully. Nov 03 20:41:41 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d Nov 03 20:41:41 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-20da39bb-466d-411e-b6df-2b49c0aeb610 tempest-VolumeDependencyTests-1931646048 None] Lock "cinder-1ce645c1-020e-478d-9167-766b73045168-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:41 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-fc90c434-ffba-4d92-b127-1a27a9bcf584" returned: 0 in 0.306s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-fc90c434-ffba-4d92-b127-1a27a9bcf584" released by "delete_volume" :: held 0.813s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:42 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d" returned: 0 in 0.308s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0236b6e5-6177-4c5e-b399-f3a46ed313a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e17712-b054-434d-a7d6-eac3be593d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Created reservations ['d0e24301-7e8b-43e4-8e5c-f7b47652421d', 'c3e76474-aed0-41ef-94ec-adedf3587665', '2688bf85-dd58-4a3c-8061-f11c6d21bd26', '4decb3c2-0296-48a6-b623-8cb6bc8eed16'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:42 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d (aba0cada-97a7-4ae6-9018-88bfd1cfe78d): created successfully Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e17712-b054-434d-a7d6-eac3be593d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (ae2d8e15-135f-40ff-a63f-4d04a25931b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-39f00023-5bc8-4072-93c8-99afef726d37 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created volume successfully. Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:42 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:42 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-b76688e3-6636-41a9-8e34-309aef73d872-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-b76688e3-6636-41a9-8e34-309aef73d872-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-quobyte-b76688e3-6636-41a9-8e34-309aef73d872" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-b76688e3-6636-41a9-8e34-309aef73d872" acquired by "delete_volume" :: waited 0.030s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[716651de-f41c-499a-96f1-872534d5fe11]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:42 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.374s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Deleted volume successfully. Nov 03 20:41:42 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872 Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1c39fe58-3e88-44d9-9235-aff7e2fa495c tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-fc90c434-ffba-4d92-b127-1a27a9bcf584-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:42 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Flow 'volume_create_manager' (64c20253-66ea-42b8-8577-3624fc9c1e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9907202-0564-4b2c-9004-488d3062d055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9907202-0564-4b2c-9004-488d3062d055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-916809961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49b5339-e001-4e49-abef-146c65a57b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b050e1f5b341359b526ecb41a31ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:43Z,use_quota=True,user_id='a39f309b67504268852a4a2f7d5f7337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2304ea2-ae67-4b14-9969-a26a804bc9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2304ea2-ae67-4b14-9969-a26a804bc9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0ac58a-0f92-4350-a12d-449e419ff80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0ac58a-0f92-4350-a12d-449e419ff80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e49b5339-e001-4e49-abef-146c65a57b17', 'volume_name': 'volume-e49b5339-e001-4e49-abef-146c65a57b17', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495a71ad-f443-4224-9979-e6e218bb64a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495a71ad-f443-4224-9979-e6e218bb64a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b8b277-8a55-443b-9177-3870478300ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:42 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Volume e49b5339-e001-4e49-abef-146c65a57b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e49b5339-e001-4e49-abef-146c65a57b17', 'volume_size': 1} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-916809961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49b5339-e001-4e49-abef-146c65a57b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b050e1f5b341359b526ecb41a31ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:43Z,use_quota=True,user_id='a39f309b67504268852a4a2f7d5f7337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Creating volume e49b5339-e001-4e49-abef-146c65a57b17 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:42 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:42 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 1073741824 Nov 03 20:41:42 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:42 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872" returned: 0 in 0.485s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:42 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872 Nov 03 20:41:42 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:43 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b76688e3-6636-41a9-8e34-309aef73d872" returned: 0 in 0.353s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-b76688e3-6636-41a9-8e34-309aef73d872" released by "delete_volume" :: held 0.903s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Created reservations ['e587540d-60cd-49b1-bd35-72a3878e15ed', '1b81d724-ff10-4158-b855-3cd0b0987f7f', 'a810c7e6-fc38-417c-bbaa-32df0841db21', '78208197-12e7-4499-9bcf-bf8b3e321972'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:43 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 1073741824" returned: 0 in 0.657s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:43 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:43 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:43 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 Nov 03 20:41:43 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (c2da2197-2199-4ada-bacc-7df1c74f3b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b151798-6359-4d62-a861-e5b32ef3cf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b151798-6359-4d62-a861-e5b32ef3cf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574022314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00b67ba-47d1-420e-a77d-b4934dff8355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:44Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1b4077-c89e-4d7e-9f35-9993183b6d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1b4077-c89e-4d7e-9f35-9993183b6d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b654bc-ea2e-44ed-9525-51c55e994ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b654bc-ea2e-44ed-9525-51c55e994ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e00b67ba-47d1-420e-a77d-b4934dff8355', 'volume_name': 'volume-e00b67ba-47d1-420e-a77d-b4934dff8355', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364773da-53ed-48b1-b083-085f7f2b95d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364773da-53ed-48b1-b083-085f7f2b95d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4499a3a-5d5b-4613-be94-2a70b4e875a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:43 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume e00b67ba-47d1-420e-a77d-b4934dff8355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e00b67ba-47d1-420e-a77d-b4934dff8355', 'volume_size': 1} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:43 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.480s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:43 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17" returned: 0 in 0.395s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.093s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574022314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00b67ba-47d1-420e-a77d-b4934dff8355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:44Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Creating volume e00b67ba-47d1-420e-a77d-b4934dff8355 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:44 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Deleted volume successfully. Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b8b277-8a55-443b-9177-3870478300ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e49b5339-e001-4e49-abef-146c65a57b17', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3dcaa3d-59f8-4aee-a0c5-6b26a47aaa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:44 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355 1073741824 Nov 03 20:41:44 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7b4a7f5d-d244-47a0-b189-87ca4f6477db tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-b76688e3-6636-41a9-8e34-309aef73d872-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:44 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Volume volume-e49b5339-e001-4e49-abef-146c65a57b17 (e49b5339-e001-4e49-abef-146c65a57b17): created successfully Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3dcaa3d-59f8-4aee-a0c5-6b26a47aaa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Flow 'volume_create_manager' (64c20253-66ea-42b8-8577-3624fc9c1e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7a879e9d-b4e8-4e84-ae69-ac1ee44c3dcf tempest-CinderUnicodeTest-776250189 None] Created volume successfully. Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (7331ca42-d022-4dac-b164-b29a9f90d2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f637eb-c4b5-49d6-91c6-a77093d0aa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f637eb-c4b5-49d6-91c6-a77093d0aa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573190479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b854253a-6450-4d6c-902d-d9bf8709df94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:44Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb5216e-244a-4d44-b7f4-9f2fe5fecddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb5216e-244a-4d44-b7f4-9f2fe5fecddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d0233d-2124-4d73-af1c-0f222780b365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d0233d-2124-4d73-af1c-0f222780b365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b854253a-6450-4d6c-902d-d9bf8709df94', 'volume_name': 'volume-b854253a-6450-4d6c-902d-d9bf8709df94', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129aa296-a402-47f9-9a83-b0ed2f5e9eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129aa296-a402-47f9-9a83-b0ed2f5e9eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c757688-27d4-4719-84cd-90213214cfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:44 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume b854253a-6450-4d6c-902d-d9bf8709df94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b854253a-6450-4d6c-902d-d9bf8709df94', 'volume_size': 1} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-quobyte-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:44 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca" acquired by "delete_volume" :: waited 0.048s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355 1073741824" returned: 0 in 0.744s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f922c5e-acee-421e-8cb4-e71fca562778]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (212a0a94-e0d4-473e-a5d1-4f45eda603e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d4b560-00da-4d7e-8fcf-b82e3dd0f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d4b560-00da-4d7e-8fcf-b82e3dd0f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1027513208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676513f3-4c0a-4e3a-a235-6763ba174cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:45Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31825ae-5dfe-4347-a160-607ada3100bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31825ae-5dfe-4347-a160-607ada3100bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c76310-80de-49b1-8aa8-d480bb7348a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c76310-80de-49b1-8aa8-d480bb7348a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676513f3-4c0a-4e3a-a235-6763ba174cfe', 'volume_name': 'volume-676513f3-4c0a-4e3a-a235-6763ba174cfe', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06bc3d7-5c3b-43aa-821a-3e895564f3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06bc3d7-5c3b-43aa-821a-3e895564f3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a6082a-ba2a-4517-be9d-ffd260249551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:44 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume 676513f3-4c0a-4e3a-a235-6763ba174cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676513f3-4c0a-4e3a-a235-6763ba174cfe', 'volume_size': 1} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:44 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca Nov 03 20:41:44 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:45 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355 Nov 03 20:41:45 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:45 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca" returned: 0 in 0.552s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:45 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:45 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (c537751a-7b1e-452c-a2c3-b7248680a563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c9b0bc-a7e9-4be6-b25a-71bfc6adf48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c9b0bc-a7e9-4be6-b25a-71bfc6adf48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3bd614-35eb-43be-a5a3-4bfaefe23753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:45Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b65f0c5-a56c-4a34-9ccc-a317d0ac8557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b65f0c5-a56c-4a34-9ccc-a317d0ac8557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d70c51-785a-4686-8272-29d91a69aff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d70c51-785a-4686-8272-29d91a69aff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3bd614-35eb-43be-a5a3-4bfaefe23753', 'volume_name': 'volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6815ad4b-8703-4ce1-b88e-c37a0c6d9d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6815ad4b-8703-4ce1-b88e-c37a0c6d9d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:45 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246ef168-d5cf-41c7-a3ad-37863321d66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:45 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume 4e3bd614-35eb-43be-a5a3-4bfaefe23753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753', 'volume_size': 1} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355" returned: 0 in 0.557s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.156s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573190479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b854253a-6450-4d6c-902d-d9bf8709df94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:44Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Creating volume b854253a-6450-4d6c-902d-d9bf8709df94 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:45 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:45 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94 1073741824 Nov 03 20:41:45 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4499a3a-5d5b-4613-be94-2a70b4e875a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00b67ba-47d1-420e-a77d-b4934dff8355', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ff070c-dcce-4ca6-b948-702fc6bea63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:45 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca" returned: 0 in 0.337s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:45 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume volume-e00b67ba-47d1-420e-a77d-b4934dff8355 (e00b67ba-47d1-420e-a77d-b4934dff8355): created successfully Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ff070c-dcce-4ca6-b948-702fc6bea63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (c2da2197-2199-4ada-bacc-7df1c74f3b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca" released by "delete_volume" :: held 1.011s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ac72045b-c859-4910-947d-b0fbd728f2a7 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created volume successfully. Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Created reservations ['d91aa21f-5d5e-41fc-b932-5e6beeb29de7', '8189a31c-6cf0-413d-bdd2-1c9dd0ad7387', 'a3452639-1b4f-4c13-ae19-a3f97fee117a', 'a5e0dc25-9b53-4b7d-9ccd-252346666b0a'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:45 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:45 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:45 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (70089b7f-30b4-40ab-8cf1-ee4312134e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60416b76-2336-458c-9d0d-71d2e28de454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60416b76-2336-458c-9d0d-71d2e28de454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-354894378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48711b05-193c-4eef-ad82-c9eae0c13a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:46Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c0cc88-c26d-4676-92b0-526348beb516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c0cc88-c26d-4676-92b0-526348beb516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1d44f3-bf5c-43cc-8564-427790741544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1d44f3-bf5c-43cc-8564-427790741544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48711b05-193c-4eef-ad82-c9eae0c13a97', 'volume_name': 'volume-48711b05-193c-4eef-ad82-c9eae0c13a97', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13333fc6-6f40-4ddd-a1ad-f6f4ffa19bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13333fc6-6f40-4ddd-a1ad-f6f4ffa19bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72c1180-59eb-4c2a-9f4c-df390677093a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:46 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume 48711b05-193c-4eef-ad82-c9eae0c13a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48711b05-193c-4eef-ad82-c9eae0c13a97', 'volume_size': 1} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:46 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94 1073741824" returned: 0 in 0.584s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:46 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94 Nov 03 20:41:46 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:46 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.292s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:46 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Deleted volume successfully. Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-f25383ca-62b6-43d4-b280-77f1e1ed02ba tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-b7cd2fc0-b077-4652-aa47-0cc7cd4090ca-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:46 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94" returned: 0 in 0.269s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.490s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1027513208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676513f3-4c0a-4e3a-a235-6763ba174cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:45Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Creating volume 676513f3-4c0a-4e3a-a235-6763ba174cfe {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:46 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c757688-27d4-4719-84cd-90213214cfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b854253a-6450-4d6c-902d-d9bf8709df94', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf0349b-d981-438e-8e37-840131a22ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:46 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe 1073741824 Nov 03 20:41:46 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:46 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume volume-b854253a-6450-4d6c-902d-d9bf8709df94 (b854253a-6450-4d6c-902d-d9bf8709df94): created successfully Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf0349b-d981-438e-8e37-840131a22ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (7331ca42-d022-4dac-b164-b29a9f90d2b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:46 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-62e39ae7-df71-480f-adf4-c760a19296bc tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created volume successfully. Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-af0584b9-ddc1-441b-b358-49701eaa6a19-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-af0584b9-ddc1-441b-b358-49701eaa6a19-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-quobyte-af0584b9-ddc1-441b-b358-49701eaa6a19" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:46 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-af0584b9-ddc1-441b-b358-49701eaa6a19" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cef717d-79d7-4f15-92ae-230b88ba9a55]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:47 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe 1073741824" returned: 0 in 0.577s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:47 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19 Nov 03 20:41:47 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe Nov 03 20:41:47 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:47 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:47 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19" returned: 0 in 0.392s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:47 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe" returned: 0 in 0.326s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.892s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3bd614-35eb-43be-a5a3-4bfaefe23753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:45Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Creating volume 4e3bd614-35eb-43be-a5a3-4bfaefe23753 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:47 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19 Nov 03 20:41:47 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:47 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a6082a-ba2a-4517-be9d-ffd260249551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676513f3-4c0a-4e3a-a235-6763ba174cfe', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47213361-9733-4f29-8d4e-f8a0c7bd626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:47 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753 1073741824 Nov 03 20:41:47 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:47 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume volume-676513f3-4c0a-4e3a-a235-6763ba174cfe (676513f3-4c0a-4e3a-a235-6763ba174cfe): created successfully Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47213361-9733-4f29-8d4e-f8a0c7bd626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (212a0a94-e0d4-473e-a5d1-4f45eda603e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:47 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-3f3cecf1-6a79-4df8-a045-256ff34f222f tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created volume successfully. Nov 03 20:41:47 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-af0584b9-ddc1-441b-b358-49701eaa6a19" returned: 0 in 0.309s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-af0584b9-ddc1-441b-b358-49701eaa6a19" released by "delete_volume" :: held 0.755s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Created reservations ['56df2100-875c-47aa-8bbd-af80fcc9ef1f', '4731ee73-aca1-43f3-abc2-5e5ad261ebe7', '53a1575d-6d30-4726-add6-5a917325e078', '295b680c-37fb-4e33-b4a5-42f9f1dc8194'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:47 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:47 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:47 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753 1073741824" returned: 0 in 0.524s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:48 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753 Nov 03 20:41:48 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-a12fa093-516f-4bb2-9b42-b2eb08c9ff02-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-a12fa093-516f-4bb2-9b42-b2eb08c9ff02-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-quobyte-a12fa093-516f-4bb2-9b42-b2eb08c9ff02" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:48 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.375s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-a12fa093-516f-4bb2-9b42-b2eb08c9ff02" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:48 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Deleted volume successfully. Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eba3d7c-e1d6-4bb4-8475-dbd8f6890c5b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e8531527-6bca-4327-8030-a541b410dfd9 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-af0584b9-ddc1-441b-b358-49701eaa6a19-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:48 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753" returned: 0 in 0.365s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.401s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246ef168-d5cf-41c7-a3ad-37863321d66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eeee6b-70c0-47e7-8d35-f44371a7ad66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] Creating offline snapshot 91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 of volume e49b5339-e001-4e49-abef-146c65a57b17 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:41:48 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753 (4e3bd614-35eb-43be-a5a3-4bfaefe23753): created successfully Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eeee6b-70c0-47e7-8d35-f44371a7ad66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (c537751a-7b1e-452c-a2c3-b7248680a563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3adeef9-4a49-4482-8889-8f9cfaef5a0b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:48 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02 Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:48 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:48 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-abce14fb-3677-41b3-8715-ab41e65a562b tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created volume successfully. Nov 03 20:41:48 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 Nov 03 20:41:48 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:48 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02" returned: 0 in 0.424s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:48 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02 Nov 03 20:41:48 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Flow 'volume_create_manager' (a3a90fb4-f3ef-4342-aec4-dac71d8b88ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e8d706-5c7a-42d2-acaf-5d07362db740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:48 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17" returned: 0 in 0.412s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e8d706-5c7a-42d2-acaf-5d07362db740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02637af8-8277-4d05-9bd3-52315d882e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fa508626be47fa92927123335f9af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:49Z,use_quota=True,user_id='de33ea0e3657489f9759251cd3255ec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7de3b8-8963-459d-bc3e-f85608c2096c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:48 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 1G Nov 03 20:41:48 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7de3b8-8963-459d-bc3e-f85608c2096c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4dd9bf-371a-4efb-a9a9-935a8a7dc62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:48 devstack cinder-volume[87342]: DEBUG cinder.image.glance [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Creating Keystone auth plugin from conf {{(pid=87342) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:41:49 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a12fa093-516f-4bb2-9b42-b2eb08c9ff02" returned: 0 in 0.304s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-a12fa093-516f-4bb2-9b42-b2eb08c9ff02" released by "delete_volume" :: held 0.794s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Created reservations ['a5d0cec8-5cc7-48b5-b416-c58553a5b9e7', 'bce2a910-0931-4360-92b2-247d45d138de', '0e3bea0a-a73d-43f1-9417-c05d2206274e', '002477a4-5ade-489a-82df-a454cb30725f'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4dd9bf-371a-4efb-a9a9-935a8a7dc62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02637af8-8277-4d05-9bd3-52315d882e28', 'volume_name': 'volume-02637af8-8277-4d05-9bd3-52315d882e28', 'volume_size': 1, 'image_id': '13da6429-73fa-4486-86cc-829632b9e219', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13da6429-73fa-4486-86cc-829632b9e219', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52a66e294a97816717ef836a83d5d1c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9fa508626be47fa92927123335f9af9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9135bef5f64ce68ead6cf03f2f5c360e3b8d5204d32f3e6dc7239b483616b9a8ee54b2956e130cf9a90cc8b62a6c57b74d03bf43da57c501ffef868bd5f03bfb', 'id': '13da6429-73fa-4486-86cc-829632b9e219', 'created_at': datetime.datetime(2026, 11, 3, 19, 41, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 41, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13da6429-73fa-4486-86cc-829632b9e219/file', 'properties': {}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158752ba-d3d5-47a9-a51d-598a55941db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158752ba-d3d5-47a9-a51d-598a55941db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c390cff5-c731-4991-9804-7e68f6048b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:49 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Volume 02637af8-8277-4d05-9bd3-52315d882e28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02637af8-8277-4d05-9bd3-52315d882e28', 'volume_size': 1, 'image_id': '13da6429-73fa-4486-86cc-829632b9e219', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13da6429-73fa-4486-86cc-829632b9e219', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52a66e294a97816717ef836a83d5d1c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9fa508626be47fa92927123335f9af9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9135bef5f64ce68ead6cf03f2f5c360e3b8d5204d32f3e6dc7239b483616b9a8ee54b2956e130cf9a90cc8b62a6c57b74d03bf43da57c501ffef868bd5f03bfb', 'id': '13da6429-73fa-4486-86cc-829632b9e219', 'created_at': datetime.datetime(2026, 11, 3, 19, 41, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 41, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13da6429-73fa-4486-86cc-829632b9e219/file', 'properties': {}}, 'image_service': } Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Trying to clone 02637af8-8277-4d05-9bd3-52315d882e28 from image 13da6429-73fa-4486-86cc-829632b9e219 at location (None, [{'url': 'file:///opt/stack/data/glance/images/13da6429-73fa-4486-86cc-829632b9e219', 'metadata': {}}]). {{(pid=87342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:49 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:41:49 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:41:49 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Image download 0.00 MB at 0.00 MB/s Nov 03 20:41:49 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 1G" returned: 0 in 0.525s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49b5339-e001-4e49-abef-146c65a57b17 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-5318f7cb-a707-43c0-8d4b-4f3d1ece444f-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a573d9-45a2-493c-8507-92c64831d809]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:49 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49b5339-e001-4e49-abef-146c65a57b17 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 Nov 03 20:41:49 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-5318f7cb-a707-43c0-8d4b-4f3d1ece444f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-quobyte-faf87975-62ac-4807-9832-676485933cbe" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-faf87975-62ac-4807-9832-676485933cbe" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-quobyte-5318f7cb-a707-43c0-8d4b-4f3d1ece444f" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-5318f7cb-a707-43c0-8d4b-4f3d1ece444f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Deleting offline snapshot 5318f7cb-a707-43c0-8d4b-4f3d1ece444f of volume faf87975-62ac-4807-9832-676485933cbe {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] snapshot_file for this snap is: volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56080a7-8640-483c-b0e2-40c732a8418e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:49 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD Nov 03 20:41:49 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:49 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.325s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:41:49 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Deleted volume successfully. Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a6f7def5-3b2b-496c-bf6e-19b22953b22e tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-a12fa093-516f-4bb2-9b42-b2eb08c9ff02-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:49 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f Nov 03 20:41:49 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:49 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49b5339-e001-4e49-abef-146c65a57b17 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377" returned: 0 in 0.377s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:49 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 is being set with open permissions: ugo+rw Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:49 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:49 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 Nov 03 20:41:49 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:49 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD Nov 03 20:41:49 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:49 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f" returned: 0 in 0.432s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faf87975-62ac-4807-9832-676485933cbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[219c5a5b-81a0-4299-9c85-4ecdf978807f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:50 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377" returned: 0 in 0.280s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:50 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.info Nov 03 20:41:50 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:50 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe Nov 03 20:41:50 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:50 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Temporary image 13da6429-73fa-4486-86cc-829632b9e219 is fetched for user de33ea0e3657489f9759251cd3255ec6. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd294b4-9a01-4655-81d5-56ef9fc540c5]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:50 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD Nov 03 20:41:50 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:50 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.info" returned: 0 in 0.311s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:50 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.info is being set with open permissions: ugo+rw Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:50 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.info Nov 03 20:41:50 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:50 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe" returned: 0 in 0.441s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:50 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f Nov 03 20:41:50 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:50 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:50 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.info" returned: 0 in 0.275s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.640s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-354894378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48711b05-193c-4eef-ad82-c9eae0c13a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6666f31e3c4355ac9111ed427d2f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:46Z,use_quota=True,user_id='fc80355a9414446da4ac93e15a1c2658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Creating volume 48711b05-193c-4eef-ad82-c9eae0c13a97 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:50 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-48711b05-193c-4eef-ad82-c9eae0c13a97 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:50 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-48711b05-193c-4eef-ad82-c9eae0c13a97 1073741824 Nov 03 20:41:50 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:50 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD Nov 03 20:41:50 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:50 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d2f143e4-d293-4956-9a1b-e1ba5d9622aa tempest-CinderUnicodeTest-776250189 None] Create snapshot completed successfully Nov 03 20:41:50 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f" returned: 0 in 0.379s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:50 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f Nov 03 20:41:50 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:51 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Acquiring lock "cinder-91ec08cf-1cec-4d1c-ada8-1fdd0ac27377-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-91ec08cf-1cec-4d1c-ada8-1fdd0ac27377-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Acquiring lock "cinder-quobyte-e49b5339-e001-4e49-abef-146c65a57b17" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-quobyte-e49b5339-e001-4e49-abef-146c65a57b17" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Acquiring lock "cinder-quobyte-91ec08cf-1cec-4d1c-ada8-1fdd0ac27377" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-quobyte-91ec08cf-1cec-4d1c-ada8-1fdd0ac27377" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Deleting offline snapshot 91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 of volume e49b5339-e001-4e49-abef-146c65a57b17 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:41:51 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] snapshot_file for this snap is: volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe.5318f7cb-a707-43c0-8d4b-4f3d1ece444f" returned: 0 in 0.322s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a626c9-2a1d-4aa8-b96c-2764c11d8703]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-5318f7cb-a707-43c0-8d4b-4f3d1ece444f" released by "_delete_snapshot" :: held 1.726s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-faf87975-62ac-4807-9832-676485933cbe" released by "delete_snapshot" :: held 1.752s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:51 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-48711b05-193c-4eef-ad82-c9eae0c13a97 1073741824" returned: 0 in 0.587s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Created reservations ['1bf38c9d-65f9-4057-9d6e-1aed5762faf0', '108373d1-52c9-48e8-95db-4a996806b220', '5b1f4dca-81ee-433e-b0fc-c306bb3a6b35', '8d04599b-c3d7-44d5-94be-ce3148878acd'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:51 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 Nov 03 20:41:51 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-48711b05-193c-4eef-ad82-c9eae0c13a97 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:51 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-48711b05-193c-4eef-ad82-c9eae0c13a97 Nov 03 20:41:51 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Delete snapshot completed successfully. Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-192fdfec-f138-4715-b6e5-9f0b4c51fd47 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-5318f7cb-a707-43c0-8d4b-4f3d1ece444f-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:51 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377" returned: 0 in 0.418s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e49b5339-e001-4e49-abef-146c65a57b17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:41:51 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-48711b05-193c-4eef-ad82-c9eae0c13a97" returned: 0 in 0.302s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02637af8-8277-4d05-9bd3-52315d882e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fa508626be47fa92927123335f9af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:41:49Z,use_quota=True,user_id='de33ea0e3657489f9759251cd3255ec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Creating volume 02637af8-8277-4d05-9bd3-52315d882e28 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:41:51 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f828f30-4915-4d0f-9fe1-3622df0b6a81]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:51 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 1073741824 Nov 03 20:41:51 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:51 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 Nov 03 20:41:51 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:52 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17" returned: 0 in 0.394s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:52 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72c1180-59eb-4c2a-9f4c-df390677093a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48711b05-193c-4eef-ad82-c9eae0c13a97', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:52 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a2597c-62f0-492c-9f69-3ad2b7eb0b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:41:52 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-faf87975-62ac-4807-9832-676485933cbe-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 1073741824" returned: 0 in 0.465s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-faf87975-62ac-4807-9832-676485933cbe-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:52 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Volume volume-48711b05-193c-4eef-ad82-c9eae0c13a97 (48711b05-193c-4eef-ad82-c9eae0c13a97): created successfully Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a2597c-62f0-492c-9f69-3ad2b7eb0b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Flow 'volume_create_manager' (70089b7f-30b4-40ab-8cf1-ee4312134e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:41:52 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377" returned: 0 in 0.369s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:52 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377 Nov 03 20:41:52 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "cinder-quobyte-faf87975-62ac-4807-9832-676485933cbe" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-faf87975-62ac-4807-9832-676485933cbe" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[082c676b-0a38-4826-948f-c82836e46abc]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:52 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17.91ec08cf-1cec-4d1c-ada8-1fdd0ac27377" returned: 0 in 0.259s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:52 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe Nov 03 20:41:52 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-quobyte-91ec08cf-1cec-4d1c-ada8-1fdd0ac27377" released by "_delete_snapshot" :: held 1.616s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:52 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8c400235-8700-4fa7-85ce-881b11c76b02 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created volume successfully. Nov 03 20:41:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-quobyte-e49b5339-e001-4e49-abef-146c65a57b17" released by "delete_snapshot" :: held 1.649s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:53 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe" returned: 0 in 0.387s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:53 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe Nov 03 20:41:53 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:53 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-faf87975-62ac-4807-9832-676485933cbe" returned: 0 in 0.257s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-quobyte-faf87975-62ac-4807-9832-676485933cbe" released by "delete_volume" :: held 0.706s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:53 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 Nov 03 20:41:53 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:53 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28" returned: 0 in 0.251s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:53 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:41:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:41:53 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Created reservations ['f9f61426-bc20-497c-b138-ad29af1aecd9', '30500920-fff0-4688-8158-901d3b90b186', '38899e20-265f-4788-ba20-8ba0942a6147', 'd498d75b-6771-42f8-ae97-63a9160b2bb7'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:54 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Created reservations ['1bb01d6e-f359-4b14-a92e-ae59b2cec3fb', '68f7a67a-3540-4594-a69b-fe7dfb5e9f5c', '62d45b44-0bb3-4878-a842-6cf0101fc64c', '82c7639c-458f-46a3-b87a-c64be4cf9c44'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:55 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Attempting download of 13da6429-73fa-4486-86cc-829632b9e219 ((None, [{'url': 'file:///opt/stack/data/glance/images/13da6429-73fa-4486-86cc-829632b9e219', 'metadata': {}}])) to volume 02637af8-8277-4d05-9bd3-52315d882e28. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:41:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-48711b05-193c-4eef-ad82-c9eae0c13a97-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-48711b05-193c-4eef-ad82-c9eae0c13a97-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de48eae-0448-40fc-b1aa-f99781b22679]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13da6429-73fa-4486-86cc-829632b9e219_isd_zla8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13da6429-73fa-4486-86cc-829632b9e219_isd_zla8" returned: 0 in 0.340s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13da6429-73fa-4486-86cc-829632b9e219_isd_zla8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-quobyte-48711b05-193c-4eef-ad82-c9eae0c13a97" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-48711b05-193c-4eef-ad82-c9eae0c13a97" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[372dae13-a453-4c47-aa8c-cb739a2e31cb]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-48711b05-193c-4eef-ad82-c9eae0c13a97 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13da6429-73fa-4486-86cc-829632b9e219_isd_zla8" returned: 1 in 0.335s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13da6429-73fa-4486-86cc-829632b9e219_isd_zla8' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a214313a-2f6b-40c0-874e-1691ffbf92e6]: (4, 'raw') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-48711b05-193c-4eef-ad82-c9eae0c13a97" returned: 0 in 0.371s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-48711b05-193c-4eef-ad82-c9eae0c13a97 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:56 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD Nov 03 20:41:56 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:57 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-48711b05-193c-4eef-ad82-c9eae0c13a97 Nov 03 20:41:57 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Acquiring lock "cinder-e49b5339-e001-4e49-abef-146c65a57b17-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:57 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-e49b5339-e001-4e49-abef-146c65a57b17-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:57 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-48711b05-193c-4eef-ad82-c9eae0c13a97" returned: 0 in 0.281s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-48711b05-193c-4eef-ad82-c9eae0c13a97" released by "delete_volume" :: held 0.706s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:57 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD Nov 03 20:41:57 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:57 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] 13da6429-73fa-4486-86cc-829632b9e219 was raw, converting to qcow2 {{(pid=87342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:57 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 Nov 03 20:41:57 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:57 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Delete snapshot completed successfully. Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e1135053-5c21-4e46-bad3-0cf9af616bf2 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-91ec08cf-1cec-4d1c-ada8-1fdd0ac27377-delete_snapshot" released by "delete_snapshot" :: held 6.574s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Acquiring lock "cinder-quobyte-e49b5339-e001-4e49-abef-146c65a57b17" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:41:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-quobyte-e49b5339-e001-4e49-abef-146c65a57b17" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb7902-819e-4bb5-84ba-137467e8042f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:58 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28" returned: 0 in 0.448s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_13da6429-73fa-4486-86cc-829632b9e219_b026fltgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:41:58 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:58 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 1G Nov 03 20:41:58 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:58 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 Nov 03 20:41:58 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:58 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 1G" returned: 0 in 0.339s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Downloaded image 13da6429-73fa-4486-86cc-829632b9e219 ((None, [{'url': 'file:///opt/stack/data/glance/images/13da6429-73fa-4486-86cc-829632b9e219', 'metadata': {}}])) to volume 02637af8-8277-4d05-9bd3-52315d882e28 successfully. {{(pid=87342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Temporary image 13da6429-73fa-4486-86cc-829632b9e219 for user de33ea0e3657489f9759251cd3255ec6 is deleted. {{(pid=87342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG cinder.volume.volume_utils [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Marking volume 02637af8-8277-4d05-9bd3-52315d882e28 as bootable. {{(pid=87342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:41:58 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17" returned: 0 in 0.421s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:41:58 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17 Nov 03 20:41:58 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:41:58 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e49b5339-e001-4e49-abef-146c65a57b17" returned: 0 in 0.257s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:41:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-quobyte-e49b5339-e001-4e49-abef-146c65a57b17" released by "delete_volume" :: held 0.744s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:41:59 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Copying metadata from image 13da6429-73fa-4486-86cc-829632b9e219 to 02637af8-8277-4d05-9bd3-52315d882e28. {{(pid=87342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:41:59 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Creating volume glance metadata for volume 02637af8-8277-4d05-9bd3-52315d882e28 backed by image 13da6429-73fa-4486-86cc-829632b9e219 with: {'image_id': '13da6429-73fa-4486-86cc-829632b9e219', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '52a66e294a97816717ef836a83d5d1c6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:41:59 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created reservations ['0027f453-b20b-4005-bb41-80bda1aff377', 'a51d48e5-2852-4f93-b454-31df42515f5d', '46099fce-9271-4252-9c7e-f74e7d5b6858', '07c300b8-9385-4ccf-9009-8ff5d7539072'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:41:59 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Created reservations ['08767f57-356b-4277-bd18-bd8cb83c0d7d', 'cc3f7d3e-6054-4841-8e59-c3b7dee0850f', 'e1e6d2f0-7797-4af9-a8d6-2028ebf78f28', 'bb8fb42f-57f6-4e48-8591-d2b8ae8a9375'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c390cff5-c731-4991-9804-7e68f6048b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02637af8-8277-4d05-9bd3-52315d882e28', 'volume_size': 1, 'image_id': '13da6429-73fa-4486-86cc-829632b9e219', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13da6429-73fa-4486-86cc-829632b9e219', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52a66e294a97816717ef836a83d5d1c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9fa508626be47fa92927123335f9af9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9135bef5f64ce68ead6cf03f2f5c360e3b8d5204d32f3e6dc7239b483616b9a8ee54b2956e130cf9a90cc8b62a6c57b74d03bf43da57c501ffef868bd5f03bfb', 'id': '13da6429-73fa-4486-86cc-829632b9e219', 'created_at': datetime.datetime(2026, 11, 3, 19, 41, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 41, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13da6429-73fa-4486-86cc-829632b9e219/file', 'properties': {}}, 'image_service': }' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65148b02-6999-4729-b9bd-aeb2f7c77f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:01 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:01 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:01 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.247s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:01 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Deleted volume successfully. Nov 03 20:42:01 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Volume volume-02637af8-8277-4d05-9bd3-52315d882e28 (02637af8-8277-4d05-9bd3-52315d882e28): created successfully Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65148b02-6999-4729-b9bd-aeb2f7c77f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Flow 'volume_create_manager' (a3a90fb4-f3ef-4342-aec4-dac71d8b88ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-4e3bd614-35eb-43be-a5a3-4bfaefe23753-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:01 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-519ce37b-b7ea-4f9d-92e4-573d1601e314 tempest-CreateVolumesFromSnapshotTest-740141342 None] Lock "cinder-faf87975-62ac-4807-9832-676485933cbe-delete_volume" released by "delete_volume" :: held 9.802s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Acquiring lock "cinder-89ae7867-0ab2-44e4-835a-309db62272f6-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:02 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-710aa00f-0bc0-4aa5-b7d5-faf8332d781e tempest-VolumeImageDependencyTests-1839526639 None] Created volume successfully. Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-4e3bd614-35eb-43be-a5a3-4bfaefe23753-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:02 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:02 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-89ae7867-0ab2-44e4-835a-309db62272f6-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:02 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:02 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Acquiring lock "cinder-quobyte-89ae7867-0ab2-44e4-835a-309db62272f6" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-quobyte-4e3bd614-35eb-43be-a5a3-4bfaefe23753" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-quobyte-89ae7867-0ab2-44e4-835a-309db62272f6" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-4e3bd614-35eb-43be-a5a3-4bfaefe23753" acquired by "delete_volume" :: waited 0.054s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4141a3a4-fee8-4cd2-bc83-f6f0bea995f2]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[728f5284-bc83-4b5f-aaa7-a25dbcd2a2ff]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:02 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.356s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:02 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Deleted volume successfully. Nov 03 20:42:02 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6 Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-538f7253-58f1-4a88-a41e-8e63491b8d8c tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-48711b05-193c-4eef-ad82-c9eae0c13a97-delete_volume" released by "delete_volume" :: held 7.047s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:02 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:02 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753 Nov 03 20:42:02 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:02 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Acquiring lock "cinder-02637af8-8277-4d05-9bd3-52315d882e28-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.510s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:02 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Deleted volume successfully. Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Lock "cinder-02637af8-8277-4d05-9bd3-52315d882e28-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a86064f4-aa14-4433-80f8-249d8b510a19 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-e49b5339-e001-4e49-abef-146c65a57b17-delete_volume" released by "delete_volume" :: held 5.408s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Acquiring lock "cinder-quobyte-02637af8-8277-4d05-9bd3-52315d882e28" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Lock "cinder-quobyte-02637af8-8277-4d05-9bd3-52315d882e28" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[455ecd3f-8e01-4a03-b250-23c6b9d13b00]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:02 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6" returned: 0 in 0.552s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:02 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6 Nov 03 20:42:02 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:02 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 Nov 03 20:42:02 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:02 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753" returned: 0 in 0.661s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:03 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753 Nov 03 20:42:03 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:03 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-89ae7867-0ab2-44e4-835a-309db62272f6" returned: 0 in 0.322s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-quobyte-89ae7867-0ab2-44e4-835a-309db62272f6" released by "delete_volume" :: held 0.989s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:03 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28" returned: 0 in 0.537s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:03 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28 Nov 03 20:42:03 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Created reservations ['59346d04-29d3-47fc-91c4-511addccee8d', 'd10f77cb-c823-409b-a971-ad2faaa4d8be', '3061048d-9870-43b6-8861-fef5d6529a47', '790383be-ddfe-4712-a796-8f95a830b47b'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:03 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3bd614-35eb-43be-a5a3-4bfaefe23753" returned: 0 in 0.429s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-4e3bd614-35eb-43be-a5a3-4bfaefe23753" released by "delete_volume" :: held 1.191s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:03 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:03 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created reservations ['06966ebb-3cdf-4b52-bb92-bd4b204cddc5', 'b187116f-cb02-485d-bdb2-38a1b9bda0e6', 'cc5ebfe6-3a0c-4527-9430-b22ac1b27490', 'ac8f7d3c-9663-4dd1-81de-a51de1786686'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:03 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-02637af8-8277-4d05-9bd3-52315d882e28" returned: 0 in 0.301s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Lock "cinder-quobyte-02637af8-8277-4d05-9bd3-52315d882e28" released by "delete_volume" :: held 0.904s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:03 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:03 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Created reservations ['c11b2f3a-8e58-48d9-b9c4-776e906a41fb', 'a59fe310-69b9-4371-b4c9-e8f1ec272cbd', 'd1600e83-3de3-452a-8d5f-a8848c3fac0c', 'dc45980d-6863-4008-b846-ebf7e4323b14'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:03 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.347s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:03 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Deleted volume successfully. Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4d736bf7-fbde-4f09-b6f3-1dcf33168318 tempest-CinderUnicodeTest-776250189 None] Lock "cinder-89ae7867-0ab2-44e4-835a-309db62272f6-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:03 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:03 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:04 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.354s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Deleted volume successfully. Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-bb8a54c4-0b15-40a5-b6b5-bff76f5192f1 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-4e3bd614-35eb-43be-a5a3-4bfaefe23753-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:04 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.337s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Deleted volume successfully. Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e4fd4b39-990b-4872-9b1f-ba9f6bead889 tempest-VolumeImageDependencyTests-1839526639 None] Lock "cinder-02637af8-8277-4d05-9bd3-52315d882e28-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-676513f3-4c0a-4e3a-a235-6763ba174cfe-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-676513f3-4c0a-4e3a-a235-6763ba174cfe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-quobyte-676513f3-4c0a-4e3a-a235-6763ba174cfe" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-676513f3-4c0a-4e3a-a235-6763ba174cfe" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d8b336-cfb5-47eb-b733-9ddb1df6d53c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:04 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe Nov 03 20:42:04 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:04 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe" returned: 0 in 0.406s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:04 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe Nov 03 20:42:04 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:05 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-676513f3-4c0a-4e3a-a235-6763ba174cfe" returned: 0 in 0.308s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-676513f3-4c0a-4e3a-a235-6763ba174cfe" released by "delete_volume" :: held 0.763s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created reservations ['708c265f-a750-46da-b751-2ef2d0f08783', '3688e209-df1f-4ce7-b6b0-f9cb3a33caa8', '1830795f-3422-40af-8f0e-da6675d63b35', '7fd17e25-73bc-4b8f-9bf6-7d3583d62cc5'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:05 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:05 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-b854253a-6450-4d6c-902d-d9bf8709df94-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-b854253a-6450-4d6c-902d-d9bf8709df94-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-quobyte-b854253a-6450-4d6c-902d-d9bf8709df94" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-b854253a-6450-4d6c-902d-d9bf8709df94" acquired by "delete_volume" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:05 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb224f2d-0102-4a37-ad8c-8ff8747c413e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.478s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:05 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Deleted volume successfully. Nov 03 20:42:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-91071482-fcf6-4096-91e8-68afa42e5325 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-676513f3-4c0a-4e3a-a235-6763ba174cfe-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:05 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94 Nov 03 20:42:05 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:06 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94" returned: 0 in 0.554s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:06 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94 Nov 03 20:42:06 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:06 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b854253a-6450-4d6c-902d-d9bf8709df94" returned: 0 in 0.470s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-b854253a-6450-4d6c-902d-d9bf8709df94" released by "delete_volume" :: held 1.107s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:06 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created reservations ['6d96f83a-70d2-4c6b-a642-450a24b354a5', 'b0fc2afe-d6db-4eb5-9e00-7a704ba7b27b', '8aab75f4-5b3a-48b5-9bd9-e22fae4ef3b3', '9d047e07-d3ac-4a05-be13-d73da43e8f82'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:07 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:07 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:07 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.301s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:07 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:07 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Deleted volume successfully. Nov 03 20:42:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-cc2010a4-460d-4d29-8d00-ac9732cd87b8 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-b854253a-6450-4d6c-902d-d9bf8709df94-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-e00b67ba-47d1-420e-a77d-b4934dff8355-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-e00b67ba-47d1-420e-a77d-b4934dff8355-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-quobyte-e00b67ba-47d1-420e-a77d-b4934dff8355" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-e00b67ba-47d1-420e-a77d-b4934dff8355" acquired by "delete_volume" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:08 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f916bb6-84b0-4f08-bb23-5a4473565115]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:08 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355 Nov 03 20:42:08 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:08 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355" returned: 0 in 0.459s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:08 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355 Nov 03 20:42:08 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:08 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-e00b67ba-47d1-420e-a77d-b4934dff8355" returned: 0 in 0.308s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-e00b67ba-47d1-420e-a77d-b4934dff8355" released by "delete_volume" :: held 0.845s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:08 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created reservations ['3dfd7478-b54c-4b57-90b0-770f20085926', '22066ac1-81ff-438f-9e8d-79139a986031', 'a98c2a94-f880-4b2d-ac17-84d2cf7d05ab', '1c02dd5a-a2a8-4a9e-9370-17a138268939'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-7cb82ef8-9734-4c23-9a11-dba97af72379 tempest-ProjectAdminTests-1439292222 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6631889343262, 'free_capacity_gb': 1773.6631889343262, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87342) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:09 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:09 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-aba0cada-97a7-4ae6-9018-88bfd1cfe78d-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-aba0cada-97a7-4ae6-9018-88bfd1cfe78d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "cinder-quobyte-aba0cada-97a7-4ae6-9018-88bfd1cfe78d" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-aba0cada-97a7-4ae6-9018-88bfd1cfe78d" acquired by "delete_volume" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[36902f23-10fc-410a-bdfb-ef741b76bf87]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:09 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.368s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:09 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Deleted volume successfully. Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0d6847a9-b4dc-4046-b04f-a2eaed6e05ab tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-e00b67ba-47d1-420e-a77d-b4934dff8355-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:09 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d Nov 03 20:42:09 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:09 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (66831405-7eb0-49a6-9f7b-7291e9e57529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9187d37-a18e-4d08-b5f0-e715a9c16e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d" returned: 0 in 0.524s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:10 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d Nov 03 20:42:10 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9187d37-a18e-4d08-b5f0-e715a9c16e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894768974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95651e17-cd7e-48a9-bbf2-a367122181ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:10Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd607216-a4a3-4109-8e19-ace0f3cedec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd607216-a4a3-4109-8e19-ace0f3cedec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50239985-36fd-4695-a4dc-0d2cc83ca050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50239985-36fd-4695-a4dc-0d2cc83ca050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95651e17-cd7e-48a9-bbf2-a367122181ac', 'volume_name': 'volume-95651e17-cd7e-48a9-bbf2-a367122181ac', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dffba27-27fa-4890-9924-d61028277b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dffba27-27fa-4890-9924-d61028277b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de027ff1-7362-45fb-a77b-dc5001297928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:10 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Volume 95651e17-cd7e-48a9-bbf2-a367122181ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95651e17-cd7e-48a9-bbf2-a367122181ac', 'volume_size': 1} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894768974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95651e17-cd7e-48a9-bbf2-a367122181ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:10Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Creating volume 95651e17-cd7e-48a9-bbf2-a367122181ac {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:42:10 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:10 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac 1073741824 Nov 03 20:42:10 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:10 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-aba0cada-97a7-4ae6-9018-88bfd1cfe78d" returned: 0 in 0.352s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-quobyte-aba0cada-97a7-4ae6-9018-88bfd1cfe78d" released by "delete_volume" :: held 0.949s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Created reservations ['ca880140-c72f-420b-967f-1b88ee44eec9', 'c4c6d942-5135-40b0-9d07-4f72e42d0724', '09feb152-beb1-4562-ac90-9efc2744f21a', '23e901c4-9c58-4850-ac5f-82a3bdd351cb'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:10 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:10 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:10 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac 1073741824" returned: 0 in 0.743s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:10 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac Nov 03 20:42:10 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:10 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.405s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:10 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:10 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Deleted volume successfully. Nov 03 20:42:11 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72735620-d004-42de-80fd-9c67ea7ebdc6 tempest-CreateVolumesFromSourceVolumeTest-185139952 None] Lock "cinder-aba0cada-97a7-4ae6-9018-88bfd1cfe78d-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:11 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac" returned: 0 in 0.351s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:11 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:42:11 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de027ff1-7362-45fb-a77b-dc5001297928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95651e17-cd7e-48a9-bbf2-a367122181ac', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14223837-4ade-460e-82d1-c6a6d993dd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:11 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Volume volume-95651e17-cd7e-48a9-bbf2-a367122181ac (95651e17-cd7e-48a9-bbf2-a367122181ac): created successfully Nov 03 20:42:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14223837-4ade-460e-82d1-c6a6d993dd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:11 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (66831405-7eb0-49a6-9f7b-7291e9e57529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:11 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-3caa97ec-c783-4571-9b89-cfa446dfbd9d tempest-ProjectMemberTests-298078363 None] Created volume successfully. Nov 03 20:42:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:12 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] Creating offline snapshot c31bd9f6-9544-4bbf-bfcb-06fdf843c74e of volume 95651e17-cd7e-48a9-bbf2-a367122181ac {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:42:12 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[267da14e-488d-45f4-911a-d70613552ae4]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:12 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:12 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac Nov 03 20:42:12 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:13 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac" returned: 0 in 0.501s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:13 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e 1G Nov 03 20:42:13 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:13 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e 1G" returned: 0 in 0.629s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:13 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95651e17-cd7e-48a9-bbf2-a367122181ac -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:13 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95651e17-cd7e-48a9-bbf2-a367122181ac -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e Nov 03 20:42:13 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:14 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95651e17-cd7e-48a9-bbf2-a367122181ac -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e" returned: 0 in 0.442s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:14 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e is being set with open permissions: ugo+rw Nov 03 20:42:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:14 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e Nov 03 20:42:14 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:14 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e" returned: 0 in 0.288s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:14 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=195,cinder:UPDATE=268,cinder:INSERT=81,cinder:DELETE=28 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:42:14 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=294,cinder:SELECT=216,cinder:INSERT=69,cinder:DELETE=22 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:42:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:14 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.info Nov 03 20:42:14 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:14 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.info" returned: 0 in 0.302s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:14 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.info is being set with open permissions: ugo+rw Nov 03 20:42:14 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:14 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.info Nov 03 20:42:14 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:15 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.info" returned: 0 in 0.303s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:15 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a12f145c-c851-458a-a041-1dd1f3fc6f42 tempest-ProjectMemberTests-298078363 None] Create snapshot completed successfully Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-c31bd9f6-9544-4bbf-bfcb-06fdf843c74e-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Lock "cinder-c31bd9f6-9544-4bbf-bfcb-06fdf843c74e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-95651e17-cd7e-48a9-bbf2-a367122181ac" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-95651e17-cd7e-48a9-bbf2-a367122181ac" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-c31bd9f6-9544-4bbf-bfcb-06fdf843c74e" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-c31bd9f6-9544-4bbf-bfcb-06fdf843c74e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Deleting offline snapshot c31bd9f6-9544-4bbf-bfcb-06fdf843c74e of volume 95651e17-cd7e-48a9-bbf2-a367122181ac {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] snapshot_file for this snap is: volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa488d9-3777-4d06-988e-b39dbca19004]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:16 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e Nov 03 20:42:16 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:16 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e" returned: 0 in 0.395s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95651e17-cd7e-48a9-bbf2-a367122181ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:42:16 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee35036-3524-4585-a16b-90c4223d3947]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:16 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac Nov 03 20:42:16 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:16 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac" returned: 0 in 0.418s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:16 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e Nov 03 20:42:16 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:17 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e" returned: 0 in 0.414s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:17 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e Nov 03 20:42:17 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:17 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac.c31bd9f6-9544-4bbf-bfcb-06fdf843c74e" returned: 0 in 0.363s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-c31bd9f6-9544-4bbf-bfcb-06fdf843c74e" released by "_delete_snapshot" :: held 1.729s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-95651e17-cd7e-48a9-bbf2-a367122181ac" released by "delete_snapshot" :: held 1.763s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:17 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Created reservations ['51f2be14-1567-4f2f-9e62-6c99adf41f6a', 'a9b61994-9df9-426d-8ab3-e13ec2a13e29', '50453649-fa2f-4817-9fd9-98654e30f7fe', 'cae970f1-6c54-4946-bddc-4ac721884819'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Delete snapshot completed successfully. Nov 03 20:42:17 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-d5f04763-f0ec-48e7-b4c7-c4d81febac3e tempest-ProjectMemberTests-298078363 None] Lock "cinder-c31bd9f6-9544-4bbf-bfcb-06fdf843c74e-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-95651e17-cd7e-48a9-bbf2-a367122181ac-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Lock "cinder-95651e17-cd7e-48a9-bbf2-a367122181ac-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-95651e17-cd7e-48a9-bbf2-a367122181ac" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-95651e17-cd7e-48a9-bbf2-a367122181ac" acquired by "delete_volume" :: waited 0.036s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d167ea5c-7152-44c8-b2a6-09a3cff44e10]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:18 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac Nov 03 20:42:18 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:18 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac" returned: 0 in 0.418s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:18 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac Nov 03 20:42:18 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:18 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-95651e17-cd7e-48a9-bbf2-a367122181ac" returned: 0 in 0.263s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-95651e17-cd7e-48a9-bbf2-a367122181ac" released by "delete_volume" :: held 0.774s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:19 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Created reservations ['c9764245-20b6-4636-b04c-87f8cac8df9e', '94b41717-b326-4caf-8d3e-b068e35bfa88', 'ddb925eb-8f98-46db-b5b9-c6c016edeabf', '80943c58-3034-4ca0-8ad5-9af8eac83e39'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:19 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:19 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:19 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.406s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:19 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:19 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Deleted volume successfully. Nov 03 20:42:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-72a894ef-bf58-4ea9-a217-c9db6c9093b9 tempest-ProjectMemberTests-298078363 None] Lock "cinder-95651e17-cd7e-48a9-bbf2-a367122181ac-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (120007ff-2d41-49aa-93f2-eea9c8e3e556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fc908a-8111-4e76-8dac-33ead7ec7b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fc908a-8111-4e76-8dac-33ead7ec7b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139159626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa8607b-bf04-47c3-a6e5-876394cfd716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:20Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84217155-f425-4f66-bd67-0e1c57ef497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84217155-f425-4f66-bd67-0e1c57ef497e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2316a6e3-233d-42ad-9935-88ec293eb943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2316a6e3-233d-42ad-9935-88ec293eb943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa8607b-bf04-47c3-a6e5-876394cfd716', 'volume_name': 'volume-daa8607b-bf04-47c3-a6e5-876394cfd716', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a963e36-34eb-4f8b-83c5-6cc4c310256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a963e36-34eb-4f8b-83c5-6cc4c310256e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed6cafa-99aa-4d7c-a918-bdd5aee3dbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:20 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Volume daa8607b-bf04-47c3-a6e5-876394cfd716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa8607b-bf04-47c3-a6e5-876394cfd716', 'volume_size': 1} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139159626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa8607b-bf04-47c3-a6e5-876394cfd716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:20Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Creating volume daa8607b-bf04-47c3-a6e5-876394cfd716 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:42:20 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:20 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 1073741824 Nov 03 20:42:20 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:20 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 1073741824" returned: 0 in 0.594s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:20 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 Nov 03 20:42:20 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:21 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716" returned: 0 in 0.338s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:42:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed6cafa-99aa-4d7c-a918-bdd5aee3dbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa8607b-bf04-47c3-a6e5-876394cfd716', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bd3b89-5387-4a53-b03b-3e38f3373830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:21 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Volume volume-daa8607b-bf04-47c3-a6e5-876394cfd716 (daa8607b-bf04-47c3-a6e5-876394cfd716): created successfully Nov 03 20:42:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bd3b89-5387-4a53-b03b-3e38f3373830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:21 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (120007ff-2d41-49aa-93f2-eea9c8e3e556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:21 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8fbf3878-0bae-45ac-807c-0fdb7eba7ae0 tempest-ProjectMemberTests-298078363 None] Created volume successfully. Nov 03 20:42:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] Creating offline snapshot fcf92f2d-e427-4b18-882d-6d49f0c0194a of volume daa8607b-bf04-47c3-a6e5-876394cfd716 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:42:22 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[45051955-d4cd-4187-a8df-9f75c47a9705]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:22 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 Nov 03 20:42:22 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:22 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716" returned: 0 in 0.430s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:22 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a 1G Nov 03 20:42:22 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:22 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Flow 'volume_create_manager' (74123fc3-7831-44c1-a09c-6d6ef1e89367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:22 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a1003d-6740-4c85-8dce-c4edfe133ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a1003d-6740-4c85-8dce-c4edfe133ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039068018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ed238dbaa40119bf633cee8c4e78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:23Z,use_quota=True,user_id='2f8db69f3526438eafec35bbc2eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d26bc02-0bc7-4def-96e1-66c8796a8171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d26bc02-0bc7-4def-96e1-66c8796a8171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfc5747-a712-45f2-aef9-7f68f7f4faac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfc5747-a712-45f2-aef9-7f68f7f4faac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd31a4fb7-07c4-46d0-a3fe-fa26a7f697d5', 'volume_name': 'volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac9880c-e88d-46bf-9b67-b1a9c17c299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac9880c-e88d-46bf-9b67-b1a9c17c299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aadaef64-150c-44ca-87aa-d1f4f14fc33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:23 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Volume d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5', 'volume_size': 1} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:23 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a 1G" returned: 0 in 0.554s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa8607b-bf04-47c3-a6e5-876394cfd716 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:23 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa8607b-bf04-47c3-a6e5-876394cfd716 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a Nov 03 20:42:23 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:23 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa8607b-bf04-47c3-a6e5-876394cfd716 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a" returned: 0 in 0.364s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:23 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a is being set with open permissions: ugo+rw Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:23 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a Nov 03 20:42:23 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:23 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:23 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:23 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:23 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.info Nov 03 20:42:23 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:24 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.332s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:42:24 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.info" returned: 0 in 0.332s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:24 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.info is being set with open permissions: ugo+rw Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:24 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.info Nov 03 20:42:24 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:24 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.info" returned: 0 in 0.291s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039068018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ed238dbaa40119bf633cee8c4e78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:23Z,use_quota=True,user_id='2f8db69f3526438eafec35bbc2eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Creating volume d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:42:24 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:42:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:24 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 1073741824 Nov 03 20:42:24 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:24 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-155ac79d-1b2d-4b50-917d-16a7700cb82c tempest-ProjectMemberTests-298078363 None] Create snapshot completed successfully Nov 03 20:42:25 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 1073741824" returned: 0 in 0.526s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:25 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 Nov 03 20:42:25 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:25 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5" returned: 0 in 0.253s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aadaef64-150c-44ca-87aa-d1f4f14fc33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939ab13d-51e7-4f16-849b-43bf397c67e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:25 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Volume volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 (d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5): created successfully Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939ab13d-51e7-4f16-849b-43bf397c67e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Flow 'volume_create_manager' (74123fc3-7831-44c1-a09c-6d6ef1e89367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:25 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0458cee5-ca78-43aa-978a-7345c50e6ab3 tempest-ProjectReaderTests-588692970 None] Created volume successfully. Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-fcf92f2d-e427-4b18-882d-6d49f0c0194a-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Lock "cinder-fcf92f2d-e427-4b18-882d-6d49f0c0194a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-daa8607b-bf04-47c3-a6e5-876394cfd716" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-daa8607b-bf04-47c3-a6e5-876394cfd716" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-fcf92f2d-e427-4b18-882d-6d49f0c0194a" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-fcf92f2d-e427-4b18-882d-6d49f0c0194a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Deleting offline snapshot fcf92f2d-e427-4b18-882d-6d49f0c0194a of volume daa8607b-bf04-47c3-a6e5-876394cfd716 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] snapshot_file for this snap is: volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd82aa5-f8ad-4039-a636-6ec37a0fde67]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:25 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a Nov 03 20:42:25 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:26 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a" returned: 0 in 0.416s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa8607b-bf04-47c3-a6e5-876394cfd716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f1835d-3808-422b-ac7f-df796f6a4c84]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:26 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 Nov 03 20:42:26 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] Creating offline snapshot 84bffe32-015b-4381-95ba-f18901663deb of volume d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1894b4fb-2902-4879-bcc4-0bf73506abdf]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:26 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716" returned: 0 in 0.453s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:26 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a Nov 03 20:42:26 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:26 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 Nov 03 20:42:26 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:26 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5" returned: 0 in 0.495s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:26 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb 1G Nov 03 20:42:26 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:27 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a" returned: 0 in 0.526s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:27 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a Nov 03 20:42:27 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:27 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716.fcf92f2d-e427-4b18-882d-6d49f0c0194a" returned: 0 in 0.361s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-fcf92f2d-e427-4b18-882d-6d49f0c0194a" released by "_delete_snapshot" :: held 1.931s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-daa8607b-bf04-47c3-a6e5-876394cfd716" released by "delete_snapshot" :: held 1.964s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Flow 'volume_create_manager' (3b7475ec-9f56-4a2e-804b-aca3916e790b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f577f5-f088-4b71-919b-adc4697c693f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f577f5-f088-4b71-919b-adc4697c693f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427052489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214dda13dedc4815a2b75d929cd9a7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:27Z,use_quota=True,user_id='b90d067a5e6948bf8eb3b76b44faab2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7554bc-2e0c-4435-bd18-6d004bb710d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7554bc-2e0c-4435-bd18-6d004bb710d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3724e0-320e-4f33-afc9-033f83282f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3724e0-320e-4f33-afc9-033f83282f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62d6fe1-d93f-497d-ae9c-4b84e82ee1b2', 'volume_name': 'volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ef97a4-3804-4d2f-8502-37c97f79cd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ef97a4-3804-4d2f-8502-37c97f79cd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:27 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68068ecc-75c5-4fde-be78-aaaaf9bd0837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:27 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Volume d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2', 'volume_size': 1} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb 1G" returned: 0 in 0.661s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:27 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb Nov 03 20:42:27 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Created reservations ['4edb92e7-59d0-427b-9e85-0c93fe2f3d0e', '9a80c113-66a3-49af-9201-647557c91983', '3e9424ef-8500-4a07-8f17-99792acca0c3', '3268111b-8a9d-4e04-b8ec-28ee69294a3a'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:27 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Delete snapshot completed successfully. Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-2578960d-c64f-4dd2-976d-6c8bab3c045c tempest-ProjectMemberTests-298078363 None] Lock "cinder-fcf92f2d-e427-4b18-882d-6d49f0c0194a-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:27 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb" returned: 0 in 0.315s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:27 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb is being set with open permissions: ugo+rw Nov 03 20:42:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:27 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb Nov 03 20:42:27 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:28 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb" returned: 0 in 0.269s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:28 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.info Nov 03 20:42:28 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:28 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.info" returned: 0 in 0.272s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:28 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.info is being set with open permissions: ugo+rw Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:28 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.info Nov 03 20:42:28 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:28 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.info" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427052489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214dda13dedc4815a2b75d929cd9a7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:27Z,use_quota=True,user_id='b90d067a5e6948bf8eb3b76b44faab2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Creating volume d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:42:28 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-daa8607b-bf04-47c3-a6e5-876394cfd716-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:28 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2 1073741824 Nov 03 20:42:28 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Lock "cinder-daa8607b-bf04-47c3-a6e5-876394cfd716-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:28 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-d3b52cb8-a4eb-4ae5-9472-22895da751f0 tempest-ProjectReaderTests-588692970 None] Create snapshot completed successfully Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-daa8607b-bf04-47c3-a6e5-876394cfd716" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-daa8607b-bf04-47c3-a6e5-876394cfd716" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0331da80-ec7f-4032-a706-e4f0ddd1e5fa]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:29 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 Nov 03 20:42:29 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:29 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2 1073741824" returned: 0 in 0.516s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:29 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2 Nov 03 20:42:29 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:29 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716" returned: 0 in 0.448s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:29 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716 Nov 03 20:42:29 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:29 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2" returned: 0 in 0.287s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68068ecc-75c5-4fde-be78-aaaaf9bd0837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b728353e-aea1-4bc2-97cf-383a0f0fdb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:29 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Volume volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2 (d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2): created successfully Nov 03 20:42:29 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b728353e-aea1-4bc2-97cf-383a0f0fdb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Flow 'volume_create_manager' (3b7475ec-9f56-4a2e-804b-aca3916e790b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-daa8607b-bf04-47c3-a6e5-876394cfd716" returned: 0 in 0.319s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-daa8607b-bf04-47c3-a6e5-876394cfd716" released by "delete_volume" :: held 0.843s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:29 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e4efa9b1-a658-4204-8d94-5c2b4435213e tempest-ProjectReaderTests-247278268 None] Created volume successfully. Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Created reservations ['f03731db-66b3-4a81-8ef8-cf829a707185', '28fb7a37-f3d9-47a0-a43f-866914a4e617', '02df5990-c085-4ef5-a127-dd74e413a33c', 'bf540e45-8d6a-43dd-a5ec-393e4f7040bf'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-84bffe32-015b-4381-95ba-f18901663deb-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Lock "cinder-84bffe32-015b-4381-95ba-f18901663deb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-84bffe32-015b-4381-95ba-f18901663deb" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-84bffe32-015b-4381-95ba-f18901663deb" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:29 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Deleting offline snapshot 84bffe32-015b-4381-95ba-f18901663deb of volume d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:42:30 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:30 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] snapshot_file for this snap is: volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[573ba3cf-a2bb-42bc-84fb-b7f4a52e8356]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:30 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb Nov 03 20:42:30 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:30 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.323s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:30 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Deleted volume successfully. Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c49e6860-800b-49ed-9b55-b13959f8f45f tempest-ProjectMemberTests-298078363 None] Lock "cinder-daa8607b-bf04-47c3-a6e5-876394cfd716-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:30 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb" returned: 0 in 0.480s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (bfa9571c-2c17-4df7-8bed-44a5f209ef69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f248a5-872c-4166-8908-32b4d6af9ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d3c751-cfad-4b8c-b09c-892f66bce4ec]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f248a5-872c-4166-8908-32b4d6af9ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633722333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c39fedc-6b82-4abe-b9e1-8a9c182b6585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:30Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932d4006-59f4-497d-86e8-514e12aa8fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932d4006-59f4-497d-86e8-514e12aa8fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792be614-06c0-4733-83d2-31704cd401b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792be614-06c0-4733-83d2-31704cd401b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c39fedc-6b82-4abe-b9e1-8a9c182b6585', 'volume_name': 'volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780f20e0-64c4-4186-bfc6-289b9787b878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780f20e0-64c4-4186-bfc6-289b9787b878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190a96ac-9712-43e9-861b-99dd6fa5ee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:30 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Volume 9c39fedc-6b82-4abe-b9e1-8a9c182b6585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585', 'volume_size': 1} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633722333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c39fedc-6b82-4abe-b9e1-8a9c182b6585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:30Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Creating volume 9c39fedc-6b82-4abe-b9e1-8a9c182b6585 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:42:30 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:30 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 1073741824 Nov 03 20:42:30 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:30 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 Nov 03 20:42:30 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Acquiring lock "cinder-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Lock "cinder-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Acquiring lock "cinder-quobyte-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:30 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Lock "cinder-quobyte-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4489811e-5767-488a-b711-0c297939daa5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:31 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5" returned: 0 in 0.428s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:31 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb Nov 03 20:42:31 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:31 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2 Nov 03 20:42:31 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:31 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 1073741824" returned: 0 in 0.514s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:31 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 Nov 03 20:42:31 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:31 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2" returned: 0 in 0.401s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:31 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb" returned: 0 in 0.391s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:31 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2 Nov 03 20:42:31 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:31 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb Nov 03 20:42:31 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:31 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585" returned: 0 in 0.272s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190a96ac-9712-43e9-861b-99dd6fa5ee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379a73bc-6204-472a-87f7-9bf753231725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:31 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Volume volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 (9c39fedc-6b82-4abe-b9e1-8a9c182b6585): created successfully Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379a73bc-6204-472a-87f7-9bf753231725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (bfa9571c-2c17-4df7-8bed-44a5f209ef69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:31 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a364ea20-e729-426c-9929-0796f6dfda7c tempest-ProjectMemberTests-298078363 None] Created volume successfully. Nov 03 20:42:31 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5.84bffe32-015b-4381-95ba-f18901663deb" returned: 0 in 0.247s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:31 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2" returned: 0 in 0.294s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-84bffe32-015b-4381-95ba-f18901663deb" released by "_delete_snapshot" :: held 1.724s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Lock "cinder-quobyte-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2" released by "delete_volume" :: held 0.745s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5" released by "delete_snapshot" :: held 1.783s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Created reservations ['2fdfe608-0930-4a6c-9f1a-7404272a426c', '15e0d1aa-b5cd-4cb9-aaf3-24d80b18f889', '0895fb79-df96-41ee-b197-655117e824c6', 'fafc0962-4b78-4954-8697-e6a8f77046b1'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Created reservations ['0fd4bbb0-9358-4173-ab08-16cc34691a6e', '09485678-44bb-4664-abe4-aafd57187a58', 'bee9485b-6773-42ad-b252-e08b0902a551', 'af8ca8ba-c162-4d8e-8da9-8ed45c166a49'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:31 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:31 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:31 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Delete snapshot completed successfully. Nov 03 20:42:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4a82a700-f3fa-489e-a383-8c43c0ccf9e3 tempest-ProjectReaderTests-588692970 None] Lock "cinder-84bffe32-015b-4381-95ba-f18901663deb-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Lock "cinder-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:32 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.294s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5" acquired by "delete_volume" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:32 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Deleted volume successfully. Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ccd7eb-89ac-4fb1-a657-8d5e0af99305]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-59579feb-b6fc-4820-bd42-55a9094ba71e tempest-ProjectReaderTests-247278268 None] Lock "cinder-d62d6fe1-d93f-497d-ae9c-4b84e82ee1b2-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:32 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 Nov 03 20:42:32 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Flow 'volume_create_manager' (ebb143a3-c222-4978-a10b-e503fce9ae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d613b21-0254-4d61-b280-db8574dacd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d613b21-0254-4d61-b280-db8574dacd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126113564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93801d67-d685-4b4a-a160-1795282086ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214dda13dedc4815a2b75d929cd9a7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:33Z,use_quota=True,user_id='b90d067a5e6948bf8eb3b76b44faab2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9ed047-f7f7-4b80-a638-6da968428677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9ed047-f7f7-4b80-a638-6da968428677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14875d1-b272-4391-b518-a0272dca3cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:32 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14875d1-b272-4391-b518-a0272dca3cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93801d67-d685-4b4a-a160-1795282086ca', 'volume_name': 'volume-93801d67-d685-4b4a-a160-1795282086ca', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20de254-245e-43b0-ab34-78797beadb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20de254-245e-43b0-ab34-78797beadb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3144c1-5aff-4a9c-8c15-3d0782882059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:32 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Volume 93801d67-d685-4b4a-a160-1795282086ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93801d67-d685-4b4a-a160-1795282086ca', 'volume_size': 1} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126113564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93801d67-d685-4b4a-a160-1795282086ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214dda13dedc4815a2b75d929cd9a7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:33Z,use_quota=True,user_id='b90d067a5e6948bf8eb3b76b44faab2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Creating volume 93801d67-d685-4b4a-a160-1795282086ca {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:42:32 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5" returned: 0 in 0.460s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:32 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca 1073741824 Nov 03 20:42:32 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:32 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5 Nov 03 20:42:32 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:32 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5" returned: 0 in 0.288s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5" released by "delete_volume" :: held 0.822s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Created reservations ['54fc369b-2b8e-4fce-8b9c-d17824c066b6', '276c3cc1-ca8c-47e3-a3ba-5c0a948d1ef7', '6d7c5bfe-9b51-4377-8b75-46d836a667a7', 'fbec6bf3-1706-4f07-85b2-5a82bfd6d051'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:33 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca 1073741824" returned: 0 in 0.477s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:33 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:33 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:33 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca Nov 03 20:42:33 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:33 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.273s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:33 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Deleted volume successfully. Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-aef4f81b-0464-4684-ab59-633e8eb588da tempest-ProjectReaderTests-588692970 None] Lock "cinder-d31a4fb7-07c4-46d0-a3fe-fa26a7f697d5-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:33 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca" returned: 0 in 0.259s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.641s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] Creating offline snapshot 68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 of volume 9c39fedc-6b82-4abe-b9e1-8a9c182b6585 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3144c1-5aff-4a9c-8c15-3d0782882059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93801d67-d685-4b4a-a160-1795282086ca', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ca2a45-aeae-4765-80a6-77709d479e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[91607eb0-9b68-4389-b796-6acbc9bec488]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:33 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Volume volume-93801d67-d685-4b4a-a160-1795282086ca (93801d67-d685-4b4a-a160-1795282086ca): created successfully Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ca2a45-aeae-4765-80a6-77709d479e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Flow 'volume_create_manager' (ebb143a3-c222-4978-a10b-e503fce9ae6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:33 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-680a4365-cfc4-43bd-8a3a-6c4d023e2ba0 tempest-ProjectReaderTests-247278268 None] Created volume successfully. Nov 03 20:42:33 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 Nov 03 20:42:33 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Flow 'volume_create_manager' (720d2f7a-649f-4ce3-b6ff-acbdcf5add5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36e0ee8-21d4-4a4c-846f-89be7975f001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36e0ee8-21d4-4a4c-846f-89be7975f001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312158386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8ca3dc-3f5c-486e-9594-a00fa155d4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ed238dbaa40119bf633cee8c4e78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:34Z,use_quota=True,user_id='2f8db69f3526438eafec35bbc2eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0310fe-7d0e-43ef-8a93-67f28bf57979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0310fe-7d0e-43ef-8a93-67f28bf57979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62016a7a-3369-4e3c-90c7-981e0bfae950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62016a7a-3369-4e3c-90c7-981e0bfae950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8ca3dc-3f5c-486e-9594-a00fa155d4fd', 'volume_name': 'volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a20909-0f6b-4a9d-9a7f-d645a1768a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a20909-0f6b-4a9d-9a7f-d645a1768a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0011ca0d-dad6-44be-8901-9573ffe61d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:33 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Volume 3d8ca3dc-3f5c-486e-9594-a00fa155d4fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd', 'volume_size': 1} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:33 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585" returned: 0 in 0.387s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:33 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 1G Nov 03 20:42:33 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:34 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 1G" returned: 0 in 0.404s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:34 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 Nov 03 20:42:34 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:34 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93" returned: 0 in 0.294s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:34 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 is being set with open permissions: ugo+rw Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:34 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 Nov 03 20:42:34 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Acquiring lock "cinder-93801d67-d685-4b4a-a160-1795282086ca-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Lock "cinder-93801d67-d685-4b4a-a160-1795282086ca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Acquiring lock "cinder-quobyte-93801d67-d685-4b4a-a160-1795282086ca" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Lock "cinder-quobyte-93801d67-d685-4b4a-a160-1795282086ca" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3433c3f9-f183-433b-8270-9c437f44dea1]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:34 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93" returned: 0 in 0.272s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:34 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.info Nov 03 20:42:34 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:34 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca Nov 03 20:42:34 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:35 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.info" returned: 0 in 0.258s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:35 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.info is being set with open permissions: ugo+rw Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:35 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.info Nov 03 20:42:35 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:35 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca" returned: 0 in 0.380s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:35 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca Nov 03 20:42:35 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:35 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.info" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312158386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8ca3dc-3f5c-486e-9594-a00fa155d4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ed238dbaa40119bf633cee8c4e78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:34Z,use_quota=True,user_id='2f8db69f3526438eafec35bbc2eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Creating volume 3d8ca3dc-3f5c-486e-9594-a00fa155d4fd {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:42:35 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:35 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-93801d67-d685-4b4a-a160-1795282086ca" returned: 0 in 0.270s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:35 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd 1073741824 Nov 03 20:42:35 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Lock "cinder-quobyte-93801d67-d685-4b4a-a160-1795282086ca" released by "delete_volume" :: held 0.712s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-96df4731-c2c4-4122-a5b2-75ebe244791a tempest-ProjectMemberTests-298078363 None] Create snapshot completed successfully Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Created reservations ['166737db-2d9d-4eae-8546-651ce31da659', '52350411-9f2e-489c-92d7-b79bfdb71f35', 'e5483ece-1f49-40f7-a1a0-1efec4f34cce', '63d4f7b0-5133-4f11-8050-88278287cf25'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:35 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:35 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:35 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.296s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Deleted volume successfully. Nov 03 20:42:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a72faee6-a88d-4f85-a06c-798614ea1c55 tempest-ProjectReaderTests-247278268 None] Lock "cinder-93801d67-d685-4b4a-a160-1795282086ca-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-68945c0d-bbdb-4fc0-8c77-aa9cf354cf93-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:36 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd 1073741824" returned: 0 in 0.563s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Lock "cinder-68945c0d-bbdb-4fc0-8c77-aa9cf354cf93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-9c39fedc-6b82-4abe-b9e1-8a9c182b6585" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-9c39fedc-6b82-4abe-b9e1-8a9c182b6585" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-68945c0d-bbdb-4fc0-8c77-aa9cf354cf93" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-68945c0d-bbdb-4fc0-8c77-aa9cf354cf93" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Deleting offline snapshot 68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 of volume 9c39fedc-6b82-4abe-b9e1-8a9c182b6585 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] snapshot_file for this snap is: volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c85f6a-9ae3-4ee8-bc36-b280d8a60b17]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:36 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd Nov 03 20:42:36 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:36 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 Nov 03 20:42:36 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:36 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd" returned: 0 in 0.271s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0011ca0d-dad6-44be-8901-9573ffe61d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3917dce-1593-4402-a667-c13d659a57ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Volume volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd (3d8ca3dc-3f5c-486e-9594-a00fa155d4fd): created successfully Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3917dce-1593-4402-a667-c13d659a57ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Flow 'volume_create_manager' (720d2f7a-649f-4ce3-b6ff-acbdcf5add5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:36 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-3b64873e-d76f-4a14-b011-86a1227d7e5a tempest-ProjectReaderTests-588692970 None] Created volume successfully. Nov 03 20:42:36 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93" returned: 0 in 0.405s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7d348e-dc49-4500-9cd8-c6f03d01aa68]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:36 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 Nov 03 20:42:36 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:36 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585" returned: 0 in 0.409s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:37 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 Nov 03 20:42:37 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] Creating offline snapshot 7c49f3ec-75fa-49dd-b7ad-ca4314ca308a of volume 3d8ca3dc-3f5c-486e-9594-a00fa155d4fd {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[121c6a1e-1bde-4ebb-89c8-902b7be665bc]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:37 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd Nov 03 20:42:37 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:37 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93" returned: 0 in 0.458s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:37 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93 Nov 03 20:42:37 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:37 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd" returned: 0 in 0.419s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:37 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a 1G Nov 03 20:42:37 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:37 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585.68945c0d-bbdb-4fc0-8c77-aa9cf354cf93" returned: 0 in 0.300s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-68945c0d-bbdb-4fc0-8c77-aa9cf354cf93" released by "_delete_snapshot" :: held 1.699s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-9c39fedc-6b82-4abe-b9e1-8a9c182b6585" released by "delete_snapshot" :: held 1.725s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Created reservations ['5d76bf34-9137-428a-a9fd-f33533ec816d', '9ef995b4-a745-4481-aa0f-3af40d5205a3', '7debe8a5-627a-41c5-8dd8-6571f4860d6c', '87fa6c7f-20df-4317-9533-3c060c534624'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Delete snapshot completed successfully. Nov 03 20:42:37 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-1e72ca3f-d8f4-4255-b4e9-b4fb72891a0f tempest-ProjectMemberTests-298078363 None] Lock "cinder-68945c0d-bbdb-4fc0-8c77-aa9cf354cf93-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:38 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a 1G" returned: 0 in 0.466s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:38 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a Nov 03 20:42:38 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-9c39fedc-6b82-4abe-b9e1-8a9c182b6585-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Lock "cinder-9c39fedc-6b82-4abe-b9e1-8a9c182b6585-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-9c39fedc-6b82-4abe-b9e1-8a9c182b6585" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-9c39fedc-6b82-4abe-b9e1-8a9c182b6585" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b508f555-3adc-4af4-9362-e6997e6ad499]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:38 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a" returned: 0 in 0.341s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:38 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a is being set with open permissions: ugo+rw Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:38 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a Nov 03 20:42:38 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:38 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 Nov 03 20:42:38 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:38 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a" returned: 0 in 0.264s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:38 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.info Nov 03 20:42:38 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:38 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585" returned: 0 in 0.408s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:38 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585 Nov 03 20:42:38 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:38 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.info" returned: 0 in 0.298s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:38 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.info is being set with open permissions: ugo+rw Nov 03 20:42:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:39 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.info Nov 03 20:42:39 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:39 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-9c39fedc-6b82-4abe-b9e1-8a9c182b6585" returned: 0 in 0.298s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-9c39fedc-6b82-4abe-b9e1-8a9c182b6585" released by "delete_volume" :: held 0.781s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Created reservations ['8be6f2b4-64e6-4c94-8a8c-8ea61b88a4ed', 'e3ec53ab-d340-49ce-90f2-59cddcb908a0', '300624ed-cfdd-423a-92ee-9aceab414839', '304c5a97-6947-4471-8215-73c8ba1821da'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:39 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:39 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:39 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.info" returned: 0 in 0.323s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-8f028f8d-9c8c-4184-8f6e-4ad8d052dc05 tempest-ProjectReaderTests-588692970 None] Create snapshot completed successfully Nov 03 20:42:39 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.287s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Deleted volume successfully. Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-7ccc5f23-34d0-45fe-8f04-afc08488844d tempest-ProjectMemberTests-298078363 None] Lock "cinder-9c39fedc-6b82-4abe-b9e1-8a9c182b6585-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (127bdfbc-dff0-4562-b59d-4238304ca6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e19a22-4ad7-4c2a-8ae1-df3f68d47ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e19a22-4ad7-4c2a-8ae1-df3f68d47ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-792300845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3c69f6-31dc-4d26-b5e0-99470f3486bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:40Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d3f01d-ced6-44e7-9774-16e4d359c5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d3f01d-ced6-44e7-9774-16e4d359c5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479898c2-2f2d-429c-bd05-1b623c45d0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479898c2-2f2d-429c-bd05-1b623c45d0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3c69f6-31dc-4d26-b5e0-99470f3486bf', 'volume_name': 'volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cb8b2e-0889-4caf-8c86-1072b3cfd0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cb8b2e-0889-4caf-8c86-1072b3cfd0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43063e8-25a4-4549-8d64-f2083cbec174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:40 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Volume 4e3c69f6-31dc-4d26-b5e0-99470f3486bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf', 'volume_size': 1} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-792300845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3c69f6-31dc-4d26-b5e0-99470f3486bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:40Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Creating volume 4e3c69f6-31dc-4d26-b5e0-99470f3486bf {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:42:40 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:40 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf 1073741824 Nov 03 20:42:40 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-7c49f3ec-75fa-49dd-b7ad-ca4314ca308a-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Lock "cinder-7c49f3ec-75fa-49dd-b7ad-ca4314ca308a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-7c49f3ec-75fa-49dd-b7ad-ca4314ca308a" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-7c49f3ec-75fa-49dd-b7ad-ca4314ca308a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Deleting offline snapshot 7c49f3ec-75fa-49dd-b7ad-ca4314ca308a of volume 3d8ca3dc-3f5c-486e-9594-a00fa155d4fd {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] snapshot_file for this snap is: volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[508f0165-00f9-4e16-a339-c20df25512fd]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:40 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf 1073741824" returned: 0 in 0.540s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:40 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a Nov 03 20:42:40 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:40 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf Nov 03 20:42:40 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:40 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf" returned: 0 in 0.279s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:40 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a" returned: 0 in 0.406s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43063e8-25a4-4549-8d64-f2083cbec174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5904358a-cee4-4a2b-a0f7-2a35524b2799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d45184-6fd1-4c3f-a527-35c0c6565208]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:40 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Volume volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf (4e3c69f6-31dc-4d26-b5e0-99470f3486bf): created successfully Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5904358a-cee4-4a2b-a0f7-2a35524b2799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (127bdfbc-dff0-4562-b59d-4238304ca6df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f11fdf91-9647-430c-af7a-d39a49222c15 tempest-ProjectMemberTests-298078363 None] Created volume successfully. Nov 03 20:42:41 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd Nov 03 20:42:41 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:41 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd" returned: 0 in 0.413s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:41 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a Nov 03 20:42:41 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:41 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a" returned: 0 in 0.348s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:41 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a Nov 03 20:42:41 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:41 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd.7c49f3ec-75fa-49dd-b7ad-ca4314ca308a" returned: 0 in 0.266s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-7c49f3ec-75fa-49dd-b7ad-ca4314ca308a" released by "_delete_snapshot" :: held 1.573s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd" released by "delete_snapshot" :: held 1.599s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Created reservations ['3f52936c-b493-478c-84d9-a8c176a9e41c', 'ce672a12-3247-499b-b63f-4062433bb27a', '3c9e8be4-48a1-4cc6-8021-b463ceae976f', 'd80579d4-b274-4d3d-9e32-0fd1c1c60bd9'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] Creating offline snapshot 7ac7d46f-8c51-46b9-ae47-a7d4828d859a of volume 4e3c69f6-31dc-4d26-b5e0-99470f3486bf {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:42:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Delete snapshot completed successfully. Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[02611a10-8cfb-4032-b1b4-9b464f583a02]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-576e420d-eb76-4273-a18d-71808cbfd094 tempest-ProjectReaderTests-588692970 None] Lock "cinder-7c49f3ec-75fa-49dd-b7ad-ca4314ca308a-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:42 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf Nov 03 20:42:42 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Lock "cinder-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd" acquired by "delete_volume" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0062c5-c8d6-423f-b6ac-a05aee7f3b8d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:42 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf" returned: 0 in 0.458s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:42 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a 1G Nov 03 20:42:42 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:42 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd Nov 03 20:42:42 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:43 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd" returned: 0 in 0.373s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:43 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd Nov 03 20:42:43 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:43 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a 1G" returned: 0 in 0.462s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:43 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a Nov 03 20:42:43 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:43 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd" returned: 0 in 0.310s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd" released by "delete_volume" :: held 0.776s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Created reservations ['0967588e-14f4-458d-af20-b402e72a594f', 'e83e1f06-7b10-4edd-b8a6-188a8c91a2f2', 'd0a0a43a-3a32-451e-811e-3a1e9af6eb7f', 'a70acca4-d4d9-4b00-aaf0-eb222ccf68db'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:43 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a" returned: 0 in 0.394s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:43 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a is being set with open permissions: ugo+rw Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:43 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a Nov 03 20:42:43 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:43 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:43 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:43 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a" returned: 0 in 0.379s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:44 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.325s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:44 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.info Nov 03 20:42:44 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Deleted volume successfully. Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ca7b5dd7-6118-4103-aa27-7ba54f82accc tempest-ProjectReaderTests-588692970 None] Lock "cinder-3d8ca3dc-3f5c-486e-9594-a00fa155d4fd-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Flow 'volume_create_manager' (b35ad405-7c02-40fd-98c7-da0cfd6ab21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c9d591-f16d-40c0-86ba-bcd04c4706a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c9d591-f16d-40c0-86ba-bcd04c4706a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1751547619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371c864c-a237-44af-937c-887d5e5fa94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ed238dbaa40119bf633cee8c4e78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:44Z,use_quota=True,user_id='2f8db69f3526438eafec35bbc2eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:44 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73060edf-31d1-40ad-89da-15ffa225af21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73060edf-31d1-40ad-89da-15ffa225af21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbd558d-7e2c-45b7-b08c-bc543620f490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbd558d-7e2c-45b7-b08c-bc543620f490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371c864c-a237-44af-937c-887d5e5fa94d', 'volume_name': 'volume-371c864c-a237-44af-937c-887d5e5fa94d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6b6728-7e82-49a6-b527-f759d61e10a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6b6728-7e82-49a6-b527-f759d61e10a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e59cbaa-9a6f-49aa-a601-58d7b710ad4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:44 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Volume 371c864c-a237-44af-937c-887d5e5fa94d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371c864c-a237-44af-937c-887d5e5fa94d', 'volume_size': 1} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.info" returned: 0 in 0.379s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:44 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.info is being set with open permissions: ugo+rw Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:44 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.info Nov 03 20:42:44 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:44 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.info" returned: 0 in 0.257s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.441s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.283s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1751547619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371c864c-a237-44af-937c-887d5e5fa94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ed238dbaa40119bf633cee8c4e78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:44Z,use_quota=True,user_id='2f8db69f3526438eafec35bbc2eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Creating volume 371c864c-a237-44af-937c-887d5e5fa94d {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:42:44 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:42:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:44 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d 1073741824 Nov 03 20:42:44 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-924aa601-be1c-465e-b40e-30e51b2806f0 tempest-ProjectMemberTests-298078363 None] Create snapshot completed successfully Nov 03 20:42:45 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d 1073741824" returned: 0 in 0.488s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:45 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d Nov 03 20:42:45 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-7ac7d46f-8c51-46b9-ae47-a7d4828d859a-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-7ac7d46f-8c51-46b9-ae47-a7d4828d859a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-4e3c69f6-31dc-4d26-b5e0-99470f3486bf" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-4e3c69f6-31dc-4d26-b5e0-99470f3486bf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-7ac7d46f-8c51-46b9-ae47-a7d4828d859a" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-7ac7d46f-8c51-46b9-ae47-a7d4828d859a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Deleting offline snapshot 7ac7d46f-8c51-46b9-ae47-a7d4828d859a of volume 4e3c69f6-31dc-4d26-b5e0-99470f3486bf {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:42:45 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] snapshot_file for this snap is: volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d" returned: 0 in 0.307s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6703054d-1a6b-4a98-9953-9622ea1fa5f4]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e59cbaa-9a6f-49aa-a601-58d7b710ad4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371c864c-a237-44af-937c-887d5e5fa94d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc13e2b7-efac-4aa2-8ad1-e1804f2cae5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:45 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Volume volume-371c864c-a237-44af-937c-887d5e5fa94d (371c864c-a237-44af-937c-887d5e5fa94d): created successfully Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc13e2b7-efac-4aa2-8ad1-e1804f2cae5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Flow 'volume_create_manager' (b35ad405-7c02-40fd-98c7-da0cfd6ab21c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-16432401-8c14-4592-a9c0-c23781c5f96b tempest-ProjectReaderTests-588692970 None] Created volume successfully. Nov 03 20:42:45 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a Nov 03 20:42:45 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:45 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a" returned: 0 in 0.386s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55e1dcc-e1ad-4ca4-9eb8-ffe14779b1ac]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:46 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf Nov 03 20:42:46 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:46 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf" returned: 0 in 0.405s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:46 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a Nov 03 20:42:46 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] Creating offline snapshot 57056b02-de49-4422-94d1-af222f2e5c0d of volume 371c864c-a237-44af-937c-887d5e5fa94d {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:42:46 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ccef35-1285-4439-9cf9-21970c7dfdca]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:46 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d Nov 03 20:42:46 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:46 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a" returned: 0 in 0.459s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:46 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a Nov 03 20:42:46 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:47 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d" returned: 0 in 0.417s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:47 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d 1G Nov 03 20:42:47 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:47 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf.7ac7d46f-8c51-46b9-ae47-a7d4828d859a" returned: 0 in 0.277s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-7ac7d46f-8c51-46b9-ae47-a7d4828d859a" released by "_delete_snapshot" :: held 1.652s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-4e3c69f6-31dc-4d26-b5e0-99470f3486bf" released by "delete_snapshot" :: held 1.677s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Created reservations ['2aabe914-7297-465d-a562-780ca9321fac', '683988e8-956c-43dc-8caf-b8bac1080505', '57b64a28-dbd5-4cd1-b50e-899dc7d62f1d', '899c227e-c32b-40a8-8167-55146c279e92'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:47 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Delete snapshot completed successfully. Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4021c133-8323-409d-9a48-7dec833369f1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-7ac7d46f-8c51-46b9-ae47-a7d4828d859a-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:47 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d 1G" returned: 0 in 0.504s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371c864c-a237-44af-937c-887d5e5fa94d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:47 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371c864c-a237-44af-937c-887d5e5fa94d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d Nov 03 20:42:47 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-4e3c69f6-31dc-4d26-b5e0-99470f3486bf-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Lock "cinder-4e3c69f6-31dc-4d26-b5e0-99470f3486bf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-4e3c69f6-31dc-4d26-b5e0-99470f3486bf" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-4e3c69f6-31dc-4d26-b5e0-99470f3486bf" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97133ac0-ad32-43fe-978c-88967fe87c69]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:47 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371c864c-a237-44af-937c-887d5e5fa94d -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d" returned: 0 in 0.327s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:47 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d is being set with open permissions: ugo+rw Nov 03 20:42:47 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:47 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf Nov 03 20:42:47 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:47 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d Nov 03 20:42:47 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:48 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d" returned: 0 in 0.295s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:48 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:48 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.info Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf" returned: 0 in 0.471s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:48 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:48 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf Nov 03 20:42:48 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:48 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.info" returned: 0 in 0.303s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:48 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.info is being set with open permissions: ugo+rw Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:48 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.info Nov 03 20:42:48 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:48 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-4e3c69f6-31dc-4d26-b5e0-99470f3486bf" returned: 0 in 0.336s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-4e3c69f6-31dc-4d26-b5e0-99470f3486bf" released by "delete_volume" :: held 0.897s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Created reservations ['2475f280-d656-4cc2-88ff-de4183e51074', '7f0ec949-3024-4712-ad0c-1478c9d510f7', 'c1fc6581-4933-4163-b75d-45b58854832e', 'e09117e3-1df3-48e8-b8f6-bf2a02c5c4e6'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:48 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.info" returned: 0 in 0.322s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:48 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:48 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:48 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-94c326ec-e10a-4809-9f8f-d27ba9666ab4 tempest-ProjectReaderTests-588692970 None] Create snapshot completed successfully Nov 03 20:42:49 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.290s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:49 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Deleted volume successfully. Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a43691fa-485d-4041-ae18-8679b7d4fabd tempest-ProjectMemberTests-298078363 None] Lock "cinder-4e3c69f6-31dc-4d26-b5e0-99470f3486bf-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-57056b02-de49-4422-94d1-af222f2e5c0d-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Lock "cinder-57056b02-de49-4422-94d1-af222f2e5c0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-371c864c-a237-44af-937c-887d5e5fa94d" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-371c864c-a237-44af-937c-887d5e5fa94d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-57056b02-de49-4422-94d1-af222f2e5c0d" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-57056b02-de49-4422-94d1-af222f2e5c0d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Deleting offline snapshot 57056b02-de49-4422-94d1-af222f2e5c0d of volume 371c864c-a237-44af-937c-887d5e5fa94d {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] snapshot_file for this snap is: volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95c902c-0069-49d1-93e5-decae0c03ae8]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:49 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d Nov 03 20:42:49 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:50 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d" returned: 0 in 0.444s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371c864c-a237-44af-937c-887d5e5fa94d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ca3ccb-166e-4ef4-a8d5-ab08087c61a7]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (71670385-0644-48b2-93cc-396aedced62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79f152c-4749-4369-a0c9-9cb56eddc38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79f152c-4749-4369-a0c9-9cb56eddc38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708472900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:50Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245f9608-936d-46fc-a1c8-b6c801684439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245f9608-936d-46fc-a1c8-b6c801684439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:50 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6ae9bf-c09c-41e2-a136-7c647983fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:50 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6ae9bf-c09c-41e2-a136-7c647983fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae', 'volume_name': 'volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6f46e0-2ef3-4260-92ad-3ae4f0eb9fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6f46e0-2ef3-4260-92ad-3ae4f0eb9fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac3b9fd-5fbe-4e2c-a611-b3af4f8f2bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:50 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Volume a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae', 'volume_size': 1} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708472900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:50Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Creating volume a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:42:50 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:50 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae 1073741824 Nov 03 20:42:50 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:50 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d" returned: 0 in 0.485s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:50 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:50 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d Nov 03 20:42:50 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:51 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae 1073741824" returned: 0 in 0.501s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:51 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae Nov 03 20:42:51 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:51 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d" returned: 0 in 0.455s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:51 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d Nov 03 20:42:51 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:51 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae" returned: 0 in 0.396s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac3b9fd-5fbe-4e2c-a611-b3af4f8f2bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14401ccd-2249-46ae-95a3-2dc4947bdfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:51 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Volume volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae (a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae): created successfully Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14401ccd-2249-46ae-95a3-2dc4947bdfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (71670385-0644-48b2-93cc-396aedced62f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a894cd5c-40ee-4b0e-8016-1079abfc464f tempest-ProjectMemberTests-298078363 None] Created volume successfully. Nov 03 20:42:51 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d.57056b02-de49-4422-94d1-af222f2e5c0d" returned: 0 in 0.271s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-57056b02-de49-4422-94d1-af222f2e5c0d" released by "_delete_snapshot" :: held 1.774s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-371c864c-a237-44af-937c-887d5e5fa94d" released by "delete_snapshot" :: held 1.803s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Created reservations ['d731b742-4a25-47be-ab33-5a4ae4f5649c', '7b5ea3ea-5dfe-4720-9ce4-7095699e32d3', '34dd8fac-ff6e-488e-aef6-39d303fa6686', 'f0899f96-6e54-4dc8-b70b-501571d2440a'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:51 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Delete snapshot completed successfully. Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-638e5689-36be-4476-97f8-c6289301a029 tempest-ProjectReaderTests-588692970 None] Lock "cinder-57056b02-de49-4422-94d1-af222f2e5c0d-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-371c864c-a237-44af-937c-887d5e5fa94d-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:51 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Lock "cinder-371c864c-a237-44af-937c-887d5e5fa94d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-371c864c-a237-44af-937c-887d5e5fa94d" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-371c864c-a237-44af-937c-887d5e5fa94d" acquired by "delete_volume" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f79a8f2-d728-4e86-b43c-d891de8df30f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:52 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d Nov 03 20:42:52 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:52 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d" returned: 0 in 0.402s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:52 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d Nov 03 20:42:52 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] Creating offline snapshot 5cf97595-4d74-443a-b33a-86f3e981407e of volume a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[536035f0-2b03-495e-9d42-407dc5d525ec]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:52 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-371c864c-a237-44af-937c-887d5e5fa94d" returned: 0 in 0.306s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-371c864c-a237-44af-937c-887d5e5fa94d" released by "delete_volume" :: held 0.785s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:52 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae Nov 03 20:42:52 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Created reservations ['3cb98588-0ab3-4639-a7df-1f8bd994c8e9', '1f1f5e97-51da-4b7a-b04b-ee973a7e0b5c', '7f892f7d-69f4-4440-b403-ea9c11bb5770', '5195cd4b-28d7-4b8e-a746-4441116ce3c0'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:52 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:52 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:52 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:53 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae" returned: 0 in 0.453s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:53 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e 1G Nov 03 20:42:53 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:53 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.345s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:53 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Deleted volume successfully. Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-928454f1-4f38-44a9-8d00-3bdca257d881 tempest-ProjectReaderTests-588692970 None] Lock "cinder-371c864c-a237-44af-937c-887d5e5fa94d-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:53 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e 1G" returned: 0 in 0.543s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:53 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e Nov 03 20:42:53 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Flow 'volume_create_manager' (03c4a121-0427-4dbb-b5e6-dd46cf1ceb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662420ed-b41b-4657-a3e4-2ea0838cc741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662420ed-b41b-4657-a3e4-2ea0838cc741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148011888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd62cc8-5ea8-403e-b7ec-b99bd654b1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ed238dbaa40119bf633cee8c4e78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:54Z,use_quota=True,user_id='2f8db69f3526438eafec35bbc2eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37144b64-e379-4f8f-aca9-cc5eda2b5546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37144b64-e379-4f8f-aca9-cc5eda2b5546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c65ceb7-5e6d-461c-8148-3261704add98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c65ceb7-5e6d-461c-8148-3261704add98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd62cc8-5ea8-403e-b7ec-b99bd654b1da', 'volume_name': 'volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5036611d-227e-4c88-be95-31aeb6fbacec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5036611d-227e-4c88-be95-31aeb6fbacec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb4a4f8-0c7e-485a-8f10-4debe8a905bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:53 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Volume efd62cc8-5ea8-403e-b7ec-b99bd654b1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da', 'volume_size': 1} Nov 03 20:42:53 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:54 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e" returned: 0 in 0.310s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:54 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e is being set with open permissions: ugo+rw Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:54 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e Nov 03 20:42:54 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:54 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e" returned: 0 in 0.275s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:54 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.info Nov 03 20:42:54 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:54 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.info" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:54 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.info is being set with open permissions: ugo+rw Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:54 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.info Nov 03 20:42:54 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:54 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.info" returned: 0 in 0.307s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.103s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148011888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd62cc8-5ea8-403e-b7ec-b99bd654b1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ed238dbaa40119bf633cee8c4e78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:42:54Z,use_quota=True,user_id='2f8db69f3526438eafec35bbc2eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Creating volume efd62cc8-5ea8-403e-b7ec-b99bd654b1da {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:42:54 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:42:54 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:54 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da 1073741824 Nov 03 20:42:54 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:54 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b8f4b142-a12f-4568-bb1e-9f4391a0bb70 tempest-ProjectMemberTests-298078363 None] Create snapshot completed successfully Nov 03 20:42:55 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da 1073741824" returned: 0 in 0.496s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:55 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da Nov 03 20:42:55 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:55 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da" returned: 0 in 0.283s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb4a4f8-0c7e-485a-8f10-4debe8a905bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bc6164-a439-4a4b-8684-a8dfa633f9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:55 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Volume volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da (efd62cc8-5ea8-403e-b7ec-b99bd654b1da): created successfully Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bc6164-a439-4a4b-8684-a8dfa633f9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Flow 'volume_create_manager' (03c4a121-0427-4dbb-b5e6-dd46cf1ceb9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:55 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f1b3ea4c-5611-4199-b8e8-b8904a5cb34d tempest-ProjectReaderTests-588692970 None] Created volume successfully. Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-5cf97595-4d74-443a-b33a-86f3e981407e-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Lock "cinder-5cf97595-4d74-443a-b33a-86f3e981407e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:55 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-5cf97595-4d74-443a-b33a-86f3e981407e" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:56 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-5cf97595-4d74-443a-b33a-86f3e981407e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Deleting offline snapshot 5cf97595-4d74-443a-b33a-86f3e981407e of volume a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:42:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] snapshot_file for this snap is: volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:42:56 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd8842b-f50f-45f3-a4b6-8615d26ffa2b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:56 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e Nov 03 20:42:56 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:56 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e" returned: 0 in 0.414s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:56 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:42:56 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d671611-0341-477d-9687-dcb01614fcca]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:56 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae Nov 03 20:42:56 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:56 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae" returned: 0 in 0.481s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:56 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:57 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e Nov 03 20:42:57 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] Creating offline snapshot 46ec7b0d-c28b-4a5f-8da3-bc4672233638 of volume efd62cc8-5ea8-403e-b7ec-b99bd654b1da {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2be05a4-319f-48b6-a6ab-e8c9e8899ea8]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:57 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da Nov 03 20:42:57 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:57 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e" returned: 0 in 0.481s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:57 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e Nov 03 20:42:57 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:57 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da" returned: 0 in 0.447s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:57 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 1G Nov 03 20:42:57 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:57 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae.5cf97595-4d74-443a-b33a-86f3e981407e" returned: 0 in 0.308s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-5cf97595-4d74-443a-b33a-86f3e981407e" released by "_delete_snapshot" :: held 1.815s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae" released by "delete_snapshot" :: held 1.841s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Created reservations ['2056c03b-f989-4317-be2e-3dc8e4a87d81', 'ffcb5325-e59b-4e11-bb7e-46aba9b65ebe', 'c0db4be7-0b4c-4752-ba74-b45f570e1987', 'f28b2241-4043-4e71-a738-d5ceb89d701d'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:57 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Delete snapshot completed successfully. Nov 03 20:42:57 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c335f029-28da-45b9-8071-f09da8b53f84 tempest-ProjectMemberTests-298078363 None] Lock "cinder-5cf97595-4d74-443a-b33a-86f3e981407e-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:58 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 1G" returned: 0 in 0.498s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:58 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 Nov 03 20:42:58 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Lock "cinder-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae" acquired by "delete_volume" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d0ffb6-1ffa-444b-aaa1-eb8496826507]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:58 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae Nov 03 20:42:58 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:58 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638" returned: 0 in 0.399s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:58 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 is being set with open permissions: ugo+rw Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:58 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 Nov 03 20:42:58 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:58 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae" returned: 0 in 0.390s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:58 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae Nov 03 20:42:58 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:58 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638" returned: 0 in 0.304s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:58 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.info Nov 03 20:42:58 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:58 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:58 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae" returned: 0 in 0.282s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae" released by "delete_volume" :: held 0.765s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Created reservations ['b32cfd03-d918-46fd-9ec4-75f01966c812', '4c23cdf8-3439-4071-91ca-aace28414f85', 'c8e6f568-37db-4237-95a4-8dd2607f53af', '61ca0eb5-f02c-4db2-9bfe-cfe8a129756e'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:42:59 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.info" returned: 0 in 0.303s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:59 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.info is being set with open permissions: ugo+rw Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:59 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.info Nov 03 20:42:59 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:42:59 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:42:59 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:42:59 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.info" returned: 0 in 0.325s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:42:59 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.277s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:42:59 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Deleted volume successfully. Nov 03 20:42:59 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-001ee4d7-60d2-49d2-ac34-a85c0ff1e045 tempest-ProjectReaderTests-588692970 None] Create snapshot completed successfully Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ce72d882-43f8-479a-8676-899aa707f32f tempest-ProjectMemberTests-298078363 None] Lock "cinder-a4dbd5c5-5bc7-49ef-897b-5ccd1ece2aae-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (7a339d66-a82b-4a54-81e2-9df4c2ff2d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13010a8d-ea9e-4f0d-bce6-226bc813ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13010a8d-ea9e-4f0d-bce6-226bc813ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1890311799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38708d51-9593-47b0-a0e0-41de1b311db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:00Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dca836-71a0-43de-ac82-3ad0111ed784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dca836-71a0-43de-ac82-3ad0111ed784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221556a8-e456-46da-9b89-ca5978861686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221556a8-e456-46da-9b89-ca5978861686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38708d51-9593-47b0-a0e0-41de1b311db9', 'volume_name': 'volume-38708d51-9593-47b0-a0e0-41de1b311db9', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:42:59 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36487d2f-2bbf-48dc-b6c4-36ae56504481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36487d2f-2bbf-48dc-b6c4-36ae56504481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fff6222-3499-43e4-b20a-83fa813366fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:00 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Volume 38708d51-9593-47b0-a0e0-41de1b311db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38708d51-9593-47b0-a0e0-41de1b311db9', 'volume_size': 1} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1890311799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38708d51-9593-47b0-a0e0-41de1b311db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:00Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Creating volume 38708d51-9593-47b0-a0e0-41de1b311db9 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:43:00 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:00 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 1073741824 Nov 03 20:43:00 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-46ec7b0d-c28b-4a5f-8da3-bc4672233638-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Lock "cinder-46ec7b0d-c28b-4a5f-8da3-bc4672233638-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-efd62cc8-5ea8-403e-b7ec-b99bd654b1da" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-efd62cc8-5ea8-403e-b7ec-b99bd654b1da" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-46ec7b0d-c28b-4a5f-8da3-bc4672233638" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-46ec7b0d-c28b-4a5f-8da3-bc4672233638" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Deleting offline snapshot 46ec7b0d-c28b-4a5f-8da3-bc4672233638 of volume efd62cc8-5ea8-403e-b7ec-b99bd654b1da {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] snapshot_file for this snap is: volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b001b22-4f0e-45f6-af46-d37aaac403cd]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:00 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 Nov 03 20:43:00 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:00 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 1073741824" returned: 0 in 0.685s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:00 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 Nov 03 20:43:00 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:00 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638" returned: 0 in 0.511s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:00 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d87a58-ff93-4b23-8d9c-ad2474ea0cb7]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:01 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9" returned: 0 in 0.331s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fff6222-3499-43e4-b20a-83fa813366fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38708d51-9593-47b0-a0e0-41de1b311db9', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda330e1-63bd-481d-a736-d7cc6b8dc52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:01 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Volume volume-38708d51-9593-47b0-a0e0-41de1b311db9 (38708d51-9593-47b0-a0e0-41de1b311db9): created successfully Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda330e1-63bd-481d-a736-d7cc6b8dc52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (7a339d66-a82b-4a54-81e2-9df4c2ff2d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:01 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da Nov 03 20:43:01 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:01 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-29899a90-9694-42b9-85cb-94eb4ede233e tempest-ProjectMemberTests-298078363 None] Created volume successfully. Nov 03 20:43:01 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da" returned: 0 in 0.405s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:01 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 Nov 03 20:43:01 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:43:01 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Flow 'volume_create_manager' (1ce7891c-bfe1-40f1-82d3-d811ad08dbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f195c8-85d9-478f-ba85-da3727a90ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638" returned: 0 in 0.381s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:01 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638 Nov 03 20:43:01 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f195c8-85d9-478f-ba85-da3727a90ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1934065892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8738d19-44ad-4aa4-88c8-584428a4ee57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194acc0a17574a178494c43f7c6cc9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:02Z,use_quota=True,user_id='38883b6f67b14d378a4c4f985cd6d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd57c5d9-8476-451f-8ba4-a8be5bf86564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd57c5d9-8476-451f-8ba4-a8be5bf86564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9099ad3-b29d-4a9b-98d1-4464ab1c8765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9099ad3-b29d-4a9b-98d1-4464ab1c8765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8738d19-44ad-4aa4-88c8-584428a4ee57', 'volume_name': 'volume-a8738d19-44ad-4aa4-88c8-584428a4ee57', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2fcb9d-d34b-4344-9cce-211f7abcb3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2fcb9d-d34b-4344-9cce-211f7abcb3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0708314e-3e2e-4c59-a861-8c27efb7dfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:01 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Volume a8738d19-44ad-4aa4-88c8-584428a4ee57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8738d19-44ad-4aa4-88c8-584428a4ee57', 'volume_size': 1} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1934065892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8738d19-44ad-4aa4-88c8-584428a4ee57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194acc0a17574a178494c43f7c6cc9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:02Z,use_quota=True,user_id='38883b6f67b14d378a4c4f985cd6d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Creating volume a8738d19-44ad-4aa4-88c8-584428a4ee57 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:43:01 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:43:01 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:01 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 1073741824 Nov 03 20:43:01 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:02 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da.46ec7b0d-c28b-4a5f-8da3-bc4672233638" returned: 0 in 0.249s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-46ec7b0d-c28b-4a5f-8da3-bc4672233638" released by "_delete_snapshot" :: held 1.665s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-efd62cc8-5ea8-403e-b7ec-b99bd654b1da" released by "delete_snapshot" :: held 1.695s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Created reservations ['6f900071-0b63-462d-a7bc-6dec060846aa', '99ea1181-a87c-4efb-8ba6-8707b76c6fb5', '9da0f2de-fb80-4f6e-ad68-566858aa9f42', '432afa62-1802-4c82-b85b-86d0d4204393'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:02 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Delete snapshot completed successfully. Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-0fb85d62-4c8c-4bf5-9c7a-89454f07559d tempest-ProjectReaderTests-588692970 None] Lock "cinder-46ec7b0d-c28b-4a5f-8da3-bc4672233638-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:02 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 1073741824" returned: 0 in 0.497s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:02 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 Nov 03 20:43:02 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-efd62cc8-5ea8-403e-b7ec-b99bd654b1da-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Lock "cinder-efd62cc8-5ea8-403e-b7ec-b99bd654b1da-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-efd62cc8-5ea8-403e-b7ec-b99bd654b1da" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-efd62cc8-5ea8-403e-b7ec-b99bd654b1da" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e249d978-8e7d-4799-9d34-346039235913]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:02 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.403s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] Creating offline snapshot 3a04b9f9-5204-431c-9185-ba122f54aaba of volume 38708d51-9593-47b0-a0e0-41de1b311db9 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0708314e-3e2e-4c59-a861-8c27efb7dfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8738d19-44ad-4aa4-88c8-584428a4ee57', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbde092-d29a-4d9d-9f26-bb716c31b4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2aaf7c-f2d6-49bd-9b8f-47cffbcc7ce9]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:02 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Volume volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 (a8738d19-44ad-4aa4-88c8-584428a4ee57): created successfully Nov 03 20:43:02 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da Nov 03 20:43:02 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbde092-d29a-4d9d-9f26-bb716c31b4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Flow 'volume_create_manager' (1ce7891c-bfe1-40f1-82d3-d811ad08dbf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:02 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-aef2c0d5-60e5-43f3-989a-fe56de45bdc9 tempest-SnapshotDependencyTests-273059319 None] Created volume successfully. Nov 03 20:43:02 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 Nov 03 20:43:02 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:02 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da" returned: 0 in 0.362s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:02 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:03 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da Nov 03 20:43:03 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:03 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9" returned: 0 in 0.387s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:03 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba 1G Nov 03 20:43:03 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:03 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-efd62cc8-5ea8-403e-b7ec-b99bd654b1da" returned: 0 in 0.276s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-efd62cc8-5ea8-403e-b7ec-b99bd654b1da" released by "delete_volume" :: held 0.704s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Created reservations ['655fe8a8-72f9-4f4f-9f52-e7b801a17780', 'd6b82cca-02ca-4b67-a330-e209262b7117', 'd0dd4a9e-07bc-45c0-bc49-ab10b15c285e', '9251b971-02df-45ea-827f-7ee9f8599ceb'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:03 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:03 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:03 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba 1G" returned: 0 in 0.417s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38708d51-9593-47b0-a0e0-41de1b311db9 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:03 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38708d51-9593-47b0-a0e0-41de1b311db9 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba Nov 03 20:43:03 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:03 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.276s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:03 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Deleted volume successfully. Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4b7c0057-efdf-49ce-afca-d6d203e069c9 tempest-ProjectReaderTests-588692970 None] Lock "cinder-efd62cc8-5ea8-403e-b7ec-b99bd654b1da-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:03 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38708d51-9593-47b0-a0e0-41de1b311db9 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba" returned: 0 in 0.329s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:03 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba is being set with open permissions: ugo+rw Nov 03 20:43:03 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:03 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba Nov 03 20:43:03 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:04 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba" returned: 0 in 0.300s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:04 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.info Nov 03 20:43:04 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Flow 'volume_create_manager' (b774db6d-0b80-44ec-9d52-4f5d07b496d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd22b2f1-ea40-4f53-b410-b466e963c210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd22b2f1-ea40-4f53-b410-b466e963c210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132820296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f612a5a-0b56-4b27-9270-ca7d01418856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ed238dbaa40119bf633cee8c4e78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:04Z,use_quota=True,user_id='2f8db69f3526438eafec35bbc2eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d9b4a9-8865-4c10-8f39-7eb3ae6fc7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d9b4a9-8865-4c10-8f39-7eb3ae6fc7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481ed8d5-28df-416d-8dd6-3028c035d672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481ed8d5-28df-416d-8dd6-3028c035d672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f612a5a-0b56-4b27-9270-ca7d01418856', 'volume_name': 'volume-2f612a5a-0b56-4b27-9270-ca7d01418856', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832c796d-82f3-4963-ac3b-c9820408a050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832c796d-82f3-4963-ac3b-c9820408a050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19564648-ea13-4902-9ac1-3eed033b7109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:04 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Volume 2f612a5a-0b56-4b27-9270-ca7d01418856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f612a5a-0b56-4b27-9270-ca7d01418856', 'volume_size': 1} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:04 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.info" returned: 0 in 0.279s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:04 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.info is being set with open permissions: ugo+rw Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:04 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.info Nov 03 20:43:04 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:04 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.info" returned: 0 in 0.241s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.473s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] Creating offline snapshot 7093350c-67ff-4416-86c9-26265480a9fb of volume a8738d19-44ad-4aa4-88c8-584428a4ee57 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:43:04 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-237b761e-281f-4355-925e-77d92351f56d tempest-ProjectMemberTests-298078363 None] Create snapshot completed successfully Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a90040b-87e8-42f6-b5ef-6893852e0824]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:04 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:04 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 Nov 03 20:43:04 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:05 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57" returned: 0 in 0.391s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:05 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb 1G Nov 03 20:43:05 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-3a04b9f9-5204-431c-9185-ba122f54aaba-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-3a04b9f9-5204-431c-9185-ba122f54aaba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-38708d51-9593-47b0-a0e0-41de1b311db9" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-38708d51-9593-47b0-a0e0-41de1b311db9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-3a04b9f9-5204-431c-9185-ba122f54aaba" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-3a04b9f9-5204-431c-9185-ba122f54aaba" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Deleting offline snapshot 3a04b9f9-5204-431c-9185-ba122f54aaba of volume 38708d51-9593-47b0-a0e0-41de1b311db9 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] snapshot_file for this snap is: volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2190f88-7131-4de0-9b6d-64af4e187746]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:05 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb 1G" returned: 0 in 0.454s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:05 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba Nov 03 20:43:05 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:05 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb Nov 03 20:43:05 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:05 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba" returned: 0 in 0.375s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38708d51-9593-47b0-a0e0-41de1b311db9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:43:05 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb" returned: 0 in 0.297s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:05 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb is being set with open permissions: ugo+rw Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c980e516-d611-417a-b13e-408c9a10062e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:05 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:05 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb Nov 03 20:43:05 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:06 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 Nov 03 20:43:06 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:06 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb" returned: 0 in 0.265s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:06 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.info Nov 03 20:43:06 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:06 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9" returned: 0 in 0.388s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:06 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba Nov 03 20:43:06 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:06 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.info" returned: 0 in 0.282s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:06 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.info is being set with open permissions: ugo+rw Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:06 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.info Nov 03 20:43:06 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:06 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba" returned: 0 in 0.358s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:06 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba Nov 03 20:43:06 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:06 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.info" returned: 0 in 0.257s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.424s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132820296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f612a5a-0b56-4b27-9270-ca7d01418856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ed238dbaa40119bf633cee8c4e78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:04Z,use_quota=True,user_id='2f8db69f3526438eafec35bbc2eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Creating volume 2f612a5a-0b56-4b27-9270-ca7d01418856 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:43:06 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:06 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 1073741824 Nov 03 20:43:06 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:06 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-525a50c4-7949-42b5-8728-4df7a8e7e2d7 tempest-SnapshotDependencyTests-273059319 None] Create snapshot completed successfully Nov 03 20:43:06 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9.3a04b9f9-5204-431c-9185-ba122f54aaba" returned: 0 in 0.266s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-3a04b9f9-5204-431c-9185-ba122f54aaba" released by "_delete_snapshot" :: held 1.502s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:06 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-38708d51-9593-47b0-a0e0-41de1b311db9" released by "delete_snapshot" :: held 1.525s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Created reservations ['2a937f24-ab6f-4177-8e2e-f9977b3a80d9', 'dd943f1c-fe9d-41aa-9427-5371a562ae77', '55eb5857-ef8b-4afd-b15a-b383a72765af', '6d2d042a-fb57-45ef-9adc-7da6099c895c'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:07 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Delete snapshot completed successfully. Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ee14de6b-ed97-42d7-a907-ca4e699aade7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-3a04b9f9-5204-431c-9185-ba122f54aaba-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:07 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 1073741824" returned: 0 in 0.486s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:07 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 Nov 03 20:43:07 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:07 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856" returned: 0 in 0.268s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-38708d51-9593-47b0-a0e0-41de1b311db9-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19564648-ea13-4902-9ac1-3eed033b7109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f612a5a-0b56-4b27-9270-ca7d01418856', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941d15cc-af09-40f1-8134-9e12d7f023ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Lock "cinder-38708d51-9593-47b0-a0e0-41de1b311db9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:07 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Volume volume-2f612a5a-0b56-4b27-9270-ca7d01418856 (2f612a5a-0b56-4b27-9270-ca7d01418856): created successfully Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941d15cc-af09-40f1-8134-9e12d7f023ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Flow 'volume_create_manager' (b774db6d-0b80-44ec-9d52-4f5d07b496d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:07 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a880ea11-b535-4f15-a917-d46bfa55fa39 tempest-ProjectReaderTests-588692970 None] Created volume successfully. Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-38708d51-9593-47b0-a0e0-41de1b311db9" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-38708d51-9593-47b0-a0e0-41de1b311db9" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99cf885-4653-4dba-8608-5425b23d4f36]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:07 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 Nov 03 20:43:07 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Flow 'volume_create_manager' (02e7dba0-ccb6-4676-a890-a161160f01ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e0b529-17ee-4ae9-9f53-0405fd6cfe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e0b529-17ee-4ae9-9f53-0405fd6cfe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a99cb812-1c59-49bd-85eb-b898151456fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194acc0a17574a178494c43f7c6cc9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7093350c-67ff-4416-86c9-26265480a9fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:08Z,use_quota=True,user_id='38883b6f67b14d378a4c4f985cd6d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3224e2fd-172e-43c3-aa71-de793021d97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3224e2fd-172e-43c3-aa71-de793021d97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff92674a-8944-4de0-88be-e74ca1f8d92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:07 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff92674a-8944-4de0-88be-e74ca1f8d92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a99cb812-1c59-49bd-85eb-b898151456fc', 'volume_name': 'volume-a99cb812-1c59-49bd-85eb-b898151456fc', 'volume_size': 1, 'snapshot_id': '7093350c-67ff-4416-86c9-26265480a9fb'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf25a7d5-e61a-4511-be99-27e820d1f1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf25a7d5-e61a-4511-be99-27e820d1f1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f6aa5d-48fc-4391-a15c-cab531ff9b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:08 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Volume a99cb812-1c59-49bd-85eb-b898151456fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a99cb812-1c59-49bd-85eb-b898151456fc', 'volume_size': 1, 'snapshot_id': '7093350c-67ff-4416-86c9-26265480a9fb'} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "cinder-quobyte-7093350c-67ff-4416-86c9-26265480a9fb-a99cb812-1c59-49bd-85eb-b898151456fc" by "_create_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-7093350c-67ff-4416-86c9-26265480a9fb-a99cb812-1c59-49bd-85eb-b898151456fc" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Creating volume a99cb812-1c59-49bd-85eb-b898151456fc from snapshot 7093350c-67ff-4416-86c9-26265480a9fb {{(pid=87342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "cinder-quobyte-a99cb812-1c59-49bd-85eb-b898151456fc" by "_copy_volume_from_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-a99cb812-1c59-49bd-85eb-b898151456fc" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] snapshot: 7093350c-67ff-4416-86c9-26265480a9fb, volume: a99cb812-1c59-49bd-85eb-b898151456fc, {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8792284-097d-427d-aa4d-0b67481ba4a8]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:08 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9" returned: 0 in 0.397s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:08 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9 Nov 03 20:43:08 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:08 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb Nov 03 20:43:08 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:08 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-38708d51-9593-47b0-a0e0-41de1b311db9" returned: 0 in 0.274s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-38708d51-9593-47b0-a0e0-41de1b311db9" released by "delete_volume" :: held 0.753s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:08 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb" returned: 0 in 0.386s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8738d19-44ad-4aa4-88c8-584428a4ee57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aae2a9-d444-48e5-ba41-2c7c1a03cc6b]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Created reservations ['3d4a35f8-be63-4cb4-bca9-432e1a826ab5', 'fcffc828-3f90-44c3-9385-7e8c71ecb4d1', '3187db0d-56c6-4f48-ad05-41a27e82bc85', '4bf0a57d-5195-41a0-a5b2-cb47f7f77188'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:08 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 Nov 03 20:43:08 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:08 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:08 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:08 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57" returned: 0 in 0.421s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] will copy from snapshot at /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Creating direct copy from snapshot {{(pid=87342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.utils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Path /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc not found in is_blk_device check {{(pid=87342) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:08 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.295s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:08 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:08 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc Nov 03 20:43:08 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:08 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Deleted volume successfully. Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4aaccb2a-fa01-400e-b11c-0fcbb84ecdac tempest-ProjectMemberTests-298078363 None] Lock "cinder-38708d51-9593-47b0-a0e0-41de1b311db9-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (82d8a1ab-ae25-4bc4-8ff5-2fe396e3f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c5e24d-a872-480a-8bf3-33cca26e77f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c5e24d-a872-480a-8bf3-33cca26e77f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159310813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63f1a98-309d-40fe-a7e1-6d84de2ef01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:09Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfa4291-fcfc-46cd-ab19-739bdaa14ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfa4291-fcfc-46cd-ab19-739bdaa14ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6155eb04-9e3f-4d58-ad34-8940d43a2708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6155eb04-9e3f-4d58-ad34-8940d43a2708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63f1a98-309d-40fe-a7e1-6d84de2ef01c', 'volume_name': 'volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b42273-467d-439e-b587-6dcb8337c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b42273-467d-439e-b587-6dcb8337c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1381e1-d1f4-4405-9811-f6b5d2506ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:09 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Volume d63f1a98-309d-40fe-a7e1-6d84de2ef01c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c', 'volume_size': 1} Nov 03 20:43:09 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:15 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc" returned: 0 in 6.140s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG cinder.image.image_utils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Image conversion details: src /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc {{(pid=87342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:43:15 devstack cinder-volume[87342]: INFO cinder.image.image_utils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Converted 1024.00 MB image at 166.76 MB/s Nov 03 20:43:15 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc is being set with open permissions: ugo+rw Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:15 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc Nov 03 20:43:15 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:15 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc" returned: 0 in 0.247s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-a99cb812-1c59-49bd-85eb-b898151456fc" released by "_copy_volume_from_snapshot" :: held 7.296s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=172,cinder:UPDATE=204,cinder:INSERT=59,cinder:DELETE=17 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=157,cinder:DELETE=19,cinder:INSERT=53,cinder:UPDATE=212 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-7093350c-67ff-4416-86c9-26265480a9fb-a99cb812-1c59-49bd-85eb-b898151456fc" released by "_create_volume_from_snapshot" :: held 7.366s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.383s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.741s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] Creating offline snapshot f39e088f-de13-492f-b993-e1932db75746 of volume 2f612a5a-0b56-4b27-9270-ca7d01418856 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f6aa5d-48fc-4391-a15c-cab531ff9b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a99cb812-1c59-49bd-85eb-b898151456fc', 'volume_size': 1, 'snapshot_id': '7093350c-67ff-4416-86c9-26265480a9fb'}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50ea5d3-9725-4932-ab3b-cad1390e5c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c3d41b-f613-460b-bc32-a79153091264]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:15 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Volume volume-a99cb812-1c59-49bd-85eb-b898151456fc (a99cb812-1c59-49bd-85eb-b898151456fc): created successfully Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50ea5d3-9725-4932-ab3b-cad1390e5c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Flow 'volume_create_manager' (02e7dba0-ccb6-4676-a890-a161160f01ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:15 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-81a6dff5-c955-4295-89ba-19ac03a48f15 tempest-SnapshotDependencyTests-273059319 None] Created volume successfully. Nov 03 20:43:15 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 Nov 03 20:43:15 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:15 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856" returned: 0 in 0.356s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:15 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:15 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 1G Nov 03 20:43:15 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:16 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 1G" returned: 0 in 0.384s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f612a5a-0b56-4b27-9270-ca7d01418856 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:16 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f612a5a-0b56-4b27-9270-ca7d01418856 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 Nov 03 20:43:16 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:16 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f612a5a-0b56-4b27-9270-ca7d01418856 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746" returned: 0 in 0.300s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:16 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 is being set with open permissions: ugo+rw Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:16 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 Nov 03 20:43:16 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "cinder-7093350c-67ff-4416-86c9-26265480a9fb-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-7093350c-67ff-4416-86c9-26265480a9fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "cinder-quobyte-a8738d19-44ad-4aa4-88c8-584428a4ee57" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-a8738d19-44ad-4aa4-88c8-584428a4ee57" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "cinder-quobyte-7093350c-67ff-4416-86c9-26265480a9fb" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-7093350c-67ff-4416-86c9-26265480a9fb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Deleting offline snapshot 7093350c-67ff-4416-86c9-26265480a9fb of volume a8738d19-44ad-4aa4-88c8-584428a4ee57 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] snapshot_file for this snap is: volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17c278d-ea47-4e96-aa6a-f86daa91397c]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:16 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746" returned: 0 in 0.262s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:16 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb Nov 03 20:43:16 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:16 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:16 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.info Nov 03 20:43:16 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:17 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb" returned: 0 in 0.373s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8738d19-44ad-4aa4-88c8-584428a4ee57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cb6c04-2b43-4e22-8a52-d280bc5e6c00]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:17 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.info" returned: 0 in 0.276s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:17 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.info is being set with open permissions: ugo+rw Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:17 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.info Nov 03 20:43:17 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:17 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 Nov 03 20:43:17 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:17 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.info" returned: 0 in 0.255s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.991s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159310813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63f1a98-309d-40fe-a7e1-6d84de2ef01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:09Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Creating volume d63f1a98-309d-40fe-a7e1-6d84de2ef01c {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:43:17 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:17 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c 1073741824 Nov 03 20:43:17 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:17 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-5258a506-8dda-42e8-82fb-2a3e8c7775a8 tempest-ProjectReaderTests-588692970 None] Create snapshot completed successfully Nov 03 20:43:17 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57" returned: 0 in 0.549s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:17 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb Nov 03 20:43:17 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:17 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c 1073741824" returned: 0 in 0.431s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:17 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c Nov 03 20:43:17 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:17 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb" returned: 0 in 0.361s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:17 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:17 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb Nov 03 20:43:17 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:18 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c" returned: 0 in 0.283s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1381e1-d1f4-4405-9811-f6b5d2506ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdb8d42-75d6-450c-bd63-4f1e5d789708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:18 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Volume volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c (d63f1a98-309d-40fe-a7e1-6d84de2ef01c): created successfully Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdb8d42-75d6-450c-bd63-4f1e5d789708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (82d8a1ab-ae25-4bc4-8ff5-2fe396e3f10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-f39e088f-de13-492f-b993-e1932db75746-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:18 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4d836032-ee1c-4a7b-800c-716f548c5d39 tempest-ProjectMemberTests-298078363 None] Created volume successfully. Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Lock "cinder-f39e088f-de13-492f-b993-e1932db75746-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-2f612a5a-0b56-4b27-9270-ca7d01418856" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-2f612a5a-0b56-4b27-9270-ca7d01418856" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-f39e088f-de13-492f-b993-e1932db75746" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:18 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-f39e088f-de13-492f-b993-e1932db75746" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Deleting offline snapshot f39e088f-de13-492f-b993-e1932db75746 of volume 2f612a5a-0b56-4b27-9270-ca7d01418856 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] snapshot_file for this snap is: volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57.7093350c-67ff-4416-86c9-26265480a9fb" returned: 0 in 0.305s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca35b98b-3c47-4358-808d-d02d34d04389]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-7093350c-67ff-4416-86c9-26265480a9fb" released by "_delete_snapshot" :: held 1.716s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-a8738d19-44ad-4aa4-88c8-584428a4ee57" released by "delete_snapshot" :: held 1.741s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Created reservations ['a9d5005a-1b1b-4331-a49a-86d6bdad8385', '699861d8-5d9b-46c4-a8b2-238ebf4dbbbd', '0080c0a0-9c93-4829-95d8-ab8b76e5905c', '4220afbf-1726-42a6-84ae-4f4c6ecad3b5'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:18 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 Nov 03 20:43:18 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:18 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Delete snapshot completed successfully. Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-eaef2306-9864-4eeb-8f7a-9f72731d3fc5 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-7093350c-67ff-4416-86c9-26265480a9fb-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:18 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746" returned: 0 in 0.365s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f612a5a-0b56-4b27-9270-ca7d01418856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff89426-d44f-4114-bb58-bf4aa736c96d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "cinder-a8738d19-44ad-4aa4-88c8-584428a4ee57-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-a8738d19-44ad-4aa4-88c8-584428a4ee57-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "cinder-quobyte-a8738d19-44ad-4aa4-88c8-584428a4ee57" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:18 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 Nov 03 20:43:18 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-a8738d19-44ad-4aa4-88c8-584428a4ee57" acquired by "delete_volume" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c850d856-591d-4664-81b1-ac99c722fc73]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:18 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:18 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 Nov 03 20:43:18 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:19 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856" returned: 0 in 0.409s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:19 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 Nov 03 20:43:19 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] Creating offline snapshot cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 of volume d63f1a98-309d-40fe-a7e1-6d84de2ef01c {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[39939cc3-4183-4947-bed4-731cb4ab535e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:19 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57" returned: 0 in 0.461s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:19 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57 Nov 03 20:43:19 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:19 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c Nov 03 20:43:19 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:19 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746" returned: 0 in 0.420s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:19 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746 Nov 03 20:43:19 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:19 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a8738d19-44ad-4aa4-88c8-584428a4ee57" returned: 0 in 0.272s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-a8738d19-44ad-4aa4-88c8-584428a4ee57" released by "delete_volume" :: held 0.795s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Created reservations ['f898b91b-a786-43a6-8d62-392de4db6f30', 'a98c9544-91a6-4e7e-8557-552a8c24c7bf', 'c9c37147-38ff-462b-b7f7-5c613e532569', '21532a65-8117-4c1d-bd92-54522e1a77a1'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:19 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c" returned: 0 in 0.397s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:19 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 1G Nov 03 20:43:19 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:19 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856.f39e088f-de13-492f-b993-e1932db75746" returned: 0 in 0.272s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:19 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:19 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-f39e088f-de13-492f-b993-e1932db75746" released by "_delete_snapshot" :: held 1.583s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-2f612a5a-0b56-4b27-9270-ca7d01418856" released by "delete_snapshot" :: held 1.608s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Created reservations ['6685b646-03a3-4d30-b23e-ead5094e94a2', '3836e4e5-9d32-4904-8f45-c280ea1fb15d', '8609c0bf-0053-4b06-94d9-247571c2a7f7', '13e48c76-860e-46e4-ba5b-fc3106243587'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "cinder-a99cb812-1c59-49bd-85eb-b898151456fc-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:19 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-a99cb812-1c59-49bd-85eb-b898151456fc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:20 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.271s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:20 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Deleted volume successfully. Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "cinder-quobyte-a99cb812-1c59-49bd-85eb-b898151456fc" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:20 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Delete snapshot completed successfully. Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-a99cb812-1c59-49bd-85eb-b898151456fc" acquired by "delete_volume" :: waited 0.024s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-c711c13e-9ece-478d-9f4f-fec1672f3504 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-a8738d19-44ad-4aa4-88c8-584428a4ee57-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-4ba07deb-de4b-431b-a534-ee14ce6aaa10 tempest-ProjectReaderTests-588692970 None] Lock "cinder-f39e088f-de13-492f-b993-e1932db75746-delete_snapshot" released by "delete_snapshot" :: held 1.881s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88b86cc-857d-428e-9803-d8d71e63a8f1]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:20 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 1G" returned: 0 in 0.507s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:20 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 Nov 03 20:43:20 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:20 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc Nov 03 20:43:20 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-2f612a5a-0b56-4b27-9270-ca7d01418856-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Lock "cinder-2f612a5a-0b56-4b27-9270-ca7d01418856-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Acquiring lock "cinder-quobyte-2f612a5a-0b56-4b27-9270-ca7d01418856" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-2f612a5a-0b56-4b27-9270-ca7d01418856" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:20 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc" returned: 0 in 0.406s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[76db9f7e-3a20-4443-aaad-3e49800ab06a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:20 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:20 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc Nov 03 20:43:20 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5" returned: 0 in 0.342s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:20 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 is being set with open permissions: ugo+rw Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:20 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 Nov 03 20:43:20 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:20 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 Nov 03 20:43:20 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:20 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a99cb812-1c59-49bd-85eb-b898151456fc" returned: 0 in 0.244s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-quobyte-a99cb812-1c59-49bd-85eb-b898151456fc" released by "delete_volume" :: held 0.700s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:20 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5" returned: 0 in 0.262s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Created reservations ['cec8cae8-49a4-406e-a50c-b7e493dae2bb', '87c60e3e-578c-49cb-adc3-8008769aa4ca', 'afc2e0a7-c60c-4c39-8bca-980977f4c526', '7d087851-11ff-4f14-b44e-96ad4c60e925'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:20 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.info Nov 03 20:43:20 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:20 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856" returned: 0 in 0.406s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:20 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856 Nov 03 20:43:20 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:20 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:21 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:21 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:21 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.info" returned: 0 in 0.272s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:21 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.info is being set with open permissions: ugo+rw Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:21 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.info Nov 03 20:43:21 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:21 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-2f612a5a-0b56-4b27-9270-ca7d01418856" returned: 0 in 0.364s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:21 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.351s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Lock "cinder-quobyte-2f612a5a-0b56-4b27-9270-ca7d01418856" released by "delete_volume" :: held 0.861s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:21 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Deleted volume successfully. Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a377ecae-045d-4a7c-b369-a925db29cf65 tempest-SnapshotDependencyTests-273059319 None] Lock "cinder-a99cb812-1c59-49bd-85eb-b898151456fc-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:21 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.info" returned: 0 in 0.289s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Created reservations ['ae52a3ec-d135-47dc-9808-2be78c901126', '3f9d9932-b551-41fb-b249-227bfcd85f1f', 'a701fa79-dfbc-4ad0-9906-05c2d869f08c', 'fbd24b5a-5167-4be1-89be-ee19ad7456d9'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:21 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e3ca68ed-6a3c-4da5-9512-36c3d500a367 tempest-ProjectMemberTests-298078363 None] Create snapshot completed successfully Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:21 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:21 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:21 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.266s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:21 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Deleted volume successfully. Nov 03 20:43:21 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ba8a77ea-8694-4b6a-8547-616853e4e950 tempest-ProjectReaderTests-588692970 None] Lock "cinder-2f612a5a-0b56-4b27-9270-ca7d01418856-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-d63f1a98-309d-40fe-a7e1-6d84de2ef01c" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-d63f1a98-309d-40fe-a7e1-6d84de2ef01c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Deleting offline snapshot cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 of volume d63f1a98-309d-40fe-a7e1-6d84de2ef01c {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] snapshot_file for this snap is: volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fbd8ef-ce7d-47c1-bd21-301b5f92009a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:22 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 Nov 03 20:43:22 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:22 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5" returned: 0 in 0.430s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:22 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[446d10c1-0226-4405-8ff4-996201247609]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:23 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c Nov 03 20:43:23 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:23 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c" returned: 0 in 0.397s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:23 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 Nov 03 20:43:23 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:23 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:23 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:23 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5" returned: 0 in 0.448s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:23 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:23 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5 Nov 03 20:43:23 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:24 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.346s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG oslo_service.periodic_task [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] Running periodic task VolumeManager._thread_info {{(pid=87342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread count: 28 {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-38bbe8e5-c884-415b-8ea4-72e0793d51b8 None None] thread info: [<_MainThread(MainThread, started 128869705097344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:43:24 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c.cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5" returned: 0 in 0.343s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5" released by "_delete_snapshot" :: held 1.739s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-d63f1a98-309d-40fe-a7e1-6d84de2ef01c" released by "delete_snapshot" :: held 1.765s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Created reservations ['02f89344-3676-4f1b-bc17-b801c53c1c5c', 'efc08b02-aab9-41be-9491-e6ee33fad964', '1d740eff-9e9e-4c39-9c10-584300d2a609', 'b56b02a6-f367-4096-aa0b-d2c53aba6a57'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:24 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Delete snapshot completed successfully. Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-e90b56eb-caaf-4762-9e80-636393a8d5b1 tempest-ProjectMemberTests-298078363 None] Lock "cinder-cb5917d4-0aa1-4abc-9c3b-3c8fc337e6a5-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-d63f1a98-309d-40fe-a7e1-6d84de2ef01c-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Lock "cinder-d63f1a98-309d-40fe-a7e1-6d84de2ef01c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-d63f1a98-309d-40fe-a7e1-6d84de2ef01c" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-d63f1a98-309d-40fe-a7e1-6d84de2ef01c" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4594dafe-70b1-48c9-b193-804815705940]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:24 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:24 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c Nov 03 20:43:24 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:25 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c" returned: 0 in 0.459s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:25 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c Nov 03 20:43:25 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:25 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-d63f1a98-309d-40fe-a7e1-6d84de2ef01c" returned: 0 in 0.295s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:25 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-d63f1a98-309d-40fe-a7e1-6d84de2ef01c" released by "delete_volume" :: held 0.844s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:25 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Created reservations ['6d9262c6-4097-4c23-8f46-4332721e923f', '6a8e0f02-815c-47d7-8483-28460c0c4264', '692173a2-a9b2-403b-a5f3-8ebbd6b90b9f', '9a7929ee-05bc-44c6-ad02-8c6086a60fac'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:25 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:25 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:25 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:25 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:26 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.435s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:26 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Deleted volume successfully. Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a91e260d-e333-4767-9f9c-97ae27aa8be3 tempest-ProjectMemberTests-298078363 None] Lock "cinder-d63f1a98-309d-40fe-a7e1-6d84de2ef01c-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (ac13820e-a904-4de4-924d-5fe03f5ed533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64bbbea-efc2-4830-b2ab-5fe98b881a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64bbbea-efc2-4830-b2ab-5fe98b881a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027476238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16238333-3274-4691-9656-dc597907ae43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:27Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12186d0-3c61-40c1-8b07-67094b990744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12186d0-3c61-40c1-8b07-67094b990744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b064745e-1782-4cfb-a1e1-968cc27981b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b064745e-1782-4cfb-a1e1-968cc27981b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16238333-3274-4691-9656-dc597907ae43', 'volume_name': 'volume-16238333-3274-4691-9656-dc597907ae43', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e144a33-d5ee-48ca-8804-57cc1ac0e45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e144a33-d5ee-48ca-8804-57cc1ac0e45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15dd40b5-aca0-491a-be20-1b088f0df046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:26 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Volume 16238333-3274-4691-9656-dc597907ae43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16238333-3274-4691-9656-dc597907ae43', 'volume_size': 1} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027476238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16238333-3274-4691-9656-dc597907ae43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:27Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Creating volume 16238333-3274-4691-9656-dc597907ae43 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:43:26 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:43:26 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:26 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 1073741824 Nov 03 20:43:26 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:27 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 1073741824" returned: 0 in 0.467s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:27 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 Nov 03 20:43:27 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:27 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43" returned: 0 in 0.271s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:27 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:43:27 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15dd40b5-aca0-491a-be20-1b088f0df046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16238333-3274-4691-9656-dc597907ae43', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7c96db-6b54-4672-80a6-66e23a4f739f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:27 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Volume volume-16238333-3274-4691-9656-dc597907ae43 (16238333-3274-4691-9656-dc597907ae43): created successfully Nov 03 20:43:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7c96db-6b54-4672-80a6-66e23a4f739f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:27 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (ac13820e-a904-4de4-924d-5fe03f5ed533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:27 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-da9c1e26-ff88-4372-a1ac-cf780d16102e tempest-ProjectMemberTests-298078363 None] Created volume successfully. Nov 03 20:43:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:28 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] Creating offline snapshot 488038d3-85aa-4d4a-81c8-d78673dd207d of volume 16238333-3274-4691-9656-dc597907ae43 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:43:28 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39c59b4-a4de-413a-aa2e-658dc44cb34f]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:28 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:28 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 Nov 03 20:43:28 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:29 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43" returned: 0 in 0.374s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:29 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d 1G Nov 03 20:43:29 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:29 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d 1G" returned: 0 in 0.473s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:29 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16238333-3274-4691-9656-dc597907ae43 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:29 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16238333-3274-4691-9656-dc597907ae43 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d Nov 03 20:43:29 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:30 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16238333-3274-4691-9656-dc597907ae43 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d" returned: 0 in 0.390s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:30 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d is being set with open permissions: ugo+rw Nov 03 20:43:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:30 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d Nov 03 20:43:30 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:30 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d" returned: 0 in 0.308s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:30 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.info Nov 03 20:43:30 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:30 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.info" returned: 0 in 0.266s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:30 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.info is being set with open permissions: ugo+rw Nov 03 20:43:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:30 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.info Nov 03 20:43:30 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:30 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.info" returned: 0 in 0.292s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:30 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:30 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-e8757783-b31c-402f-ad15-163299fc4d8c tempest-ProjectMemberTests-298078363 None] Create snapshot completed successfully Nov 03 20:43:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-488038d3-85aa-4d4a-81c8-d78673dd207d-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Lock "cinder-488038d3-85aa-4d4a-81c8-d78673dd207d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:31 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-16238333-3274-4691-9656-dc597907ae43" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-16238333-3274-4691-9656-dc597907ae43" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-488038d3-85aa-4d4a-81c8-d78673dd207d" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-488038d3-85aa-4d4a-81c8-d78673dd207d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Deleting offline snapshot 488038d3-85aa-4d4a-81c8-d78673dd207d of volume 16238333-3274-4691-9656-dc597907ae43 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] snapshot_file for this snap is: volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1daca0-24e3-424d-bdea-018f1d8fd52a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:32 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d Nov 03 20:43:32 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:32 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d" returned: 0 in 0.430s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16238333-3274-4691-9656-dc597907ae43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[867c449c-5855-4262-a714-99101bd2abef]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:32 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 Nov 03 20:43:32 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:32 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43" returned: 0 in 0.395s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:32 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:32 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d Nov 03 20:43:33 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:33 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d" returned: 0 in 0.367s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:33 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d Nov 03 20:43:33 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:33 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:33 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43.488038d3-85aa-4d4a-81c8-d78673dd207d" returned: 0 in 0.264s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:33 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-488038d3-85aa-4d4a-81c8-d78673dd207d" released by "_delete_snapshot" :: held 1.595s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:33 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-16238333-3274-4691-9656-dc597907ae43" released by "delete_snapshot" :: held 1.625s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:33 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Created reservations ['6793081b-7265-491a-aadf-96ece25a944a', '48e10a1f-fa89-4519-9c9f-2aa9d66ae062', '5b618fd9-f0a9-4367-adab-5dbb00d6bd43', 'ff9385df-1705-435b-8c1d-f6c6e27480f9'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:33 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Delete snapshot completed successfully. Nov 03 20:43:33 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b7dbf666-4744-45d9-aeee-0da78089af96 tempest-ProjectMemberTests-298078363 None] Lock "cinder-488038d3-85aa-4d4a-81c8-d78673dd207d-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-16238333-3274-4691-9656-dc597907ae43-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Lock "cinder-16238333-3274-4691-9656-dc597907ae43-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-16238333-3274-4691-9656-dc597907ae43" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-16238333-3274-4691-9656-dc597907ae43" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:34 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60450c1-3a2c-4e72-888a-3dc3fd8ecb6a]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:34 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 Nov 03 20:43:34 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:34 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43" returned: 0 in 0.376s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:34 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43 Nov 03 20:43:34 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:34 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:34 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-16238333-3274-4691-9656-dc597907ae43" returned: 0 in 0.252s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:34 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-16238333-3274-4691-9656-dc597907ae43" released by "delete_volume" :: held 0.692s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:34 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Created reservations ['a4a2dcd2-9f31-4558-bebd-0c810bf27b59', '6da8a471-1bda-4022-8a2e-001db6ababf1', '6274f7d0-9d67-462e-acd7-4b7531249bed', '99e950c7-8574-4ac7-8820-08979cde2739'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:35 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:35 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:35 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.259s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:35 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Deleted volume successfully. Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-603bb719-6a50-40b9-8297-7ae63fa22a79 tempest-ProjectMemberTests-298078363 None] Lock "cinder-16238333-3274-4691-9656-dc597907ae43-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (fcd6362b-d7c4-4240-8ba1-e878227bbb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39eba5c9-250d-4554-8d6f-902f0c41f09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39eba5c9-250d-4554-8d6f-902f0c41f09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615453158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64eddf6-ef58-42ca-99ee-56da2accd970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:36Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8c0edf-d32f-4a99-969a-4da81e859aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8c0edf-d32f-4a99-969a-4da81e859aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bec69de-f621-4de9-8c60-d7d12bef9740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bec69de-f621-4de9-8c60-d7d12bef9740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f64eddf6-ef58-42ca-99ee-56da2accd970', 'volume_name': 'volume-f64eddf6-ef58-42ca-99ee-56da2accd970', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac76ad6-b6fe-4873-a6bf-088341243f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:35 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac76ad6-b6fe-4873-a6bf-088341243f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a28775c-d5f5-4b0c-bf94-57c42ed35aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Volume f64eddf6-ef58-42ca-99ee-56da2accd970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f64eddf6-ef58-42ca-99ee-56da2accd970', 'volume_size': 1} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615453158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64eddf6-ef58-42ca-99ee-56da2accd970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37db854ef14557907e23a6c51c7334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:36Z,use_quota=True,user_id='9fc8d6b0d45c49c68cf84712bbe3fb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Creating volume f64eddf6-ef58-42ca-99ee-56da2accd970 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:43:36 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:43:36 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 1073741824 Nov 03 20:43:36 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Flow 'volume_create_manager' (49c19444-36fb-482c-91b8-40011623e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b8354b-bda8-490a-a952-177f6613484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b8354b-bda8-490a-a952-177f6613484d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277678139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd288c38-9138-4806-b941-3fdbaeb0b506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf259bdbd2ae493fa16c814aea6f005e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:36Z,use_quota=True,user_id='efeaecbc1a9b49fbbc7bc52feb0610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9396e91e-e1b1-42c4-9429-7310cbc81d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9396e91e-e1b1-42c4-9429-7310cbc81d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f9a670-13b0-4395-8752-71d4467b7a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f9a670-13b0-4395-8752-71d4467b7a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd288c38-9138-4806-b941-3fdbaeb0b506', 'volume_name': 'volume-cd288c38-9138-4806-b941-3fdbaeb0b506', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5f9e2e-e5be-49ab-bf7a-3913fa872354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5f9e2e-e5be-49ab-bf7a-3913fa872354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e145da5-4b12-4250-ac1c-a23b9c4ac1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Volume cd288c38-9138-4806-b941-3fdbaeb0b506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd288c38-9138-4806-b941-3fdbaeb0b506', 'volume_size': 1} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:36 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 1073741824" returned: 0 in 0.427s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:36 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 Nov 03 20:43:36 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:36 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970" returned: 0 in 0.259s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277678139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd288c38-9138-4806-b941-3fdbaeb0b506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf259bdbd2ae493fa16c814aea6f005e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:36Z,use_quota=True,user_id='efeaecbc1a9b49fbbc7bc52feb0610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Creating volume cd288c38-9138-4806-b941-3fdbaeb0b506 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:43:36 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a28775c-d5f5-4b0c-bf94-57c42ed35aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f64eddf6-ef58-42ca-99ee-56da2accd970', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:36 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506 1073741824 Nov 03 20:43:36 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64502fb-9cfb-4f58-a79d-71035a4c9bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:36 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Volume volume-f64eddf6-ef58-42ca-99ee-56da2accd970 (f64eddf6-ef58-42ca-99ee-56da2accd970): created successfully Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64502fb-9cfb-4f58-a79d-71035a4c9bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:36 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Flow 'volume_create_manager' (fcd6362b-d7c4-4240-8ba1-e878227bbb83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:36 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-64e3dcd1-491b-4314-81f7-12809fdcdbb1 tempest-ProjectMemberTests-298078363 None] Created volume successfully. Nov 03 20:43:37 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506 1073741824" returned: 0 in 0.424s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:37 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506 Nov 03 20:43:37 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:37 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506" returned: 0 in 0.244s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:37 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:43:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e145da5-4b12-4250-ac1c-a23b9c4ac1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd288c38-9138-4806-b941-3fdbaeb0b506', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec57ce3-4117-4c3f-b338-ae8a7e8c6eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:37 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Volume volume-cd288c38-9138-4806-b941-3fdbaeb0b506 (cd288c38-9138-4806-b941-3fdbaeb0b506): created successfully Nov 03 20:43:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec57ce3-4117-4c3f-b338-ae8a7e8c6eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:37 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Flow 'volume_create_manager' (49c19444-36fb-482c-91b8-40011623e2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:37 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-98d0c42d-8d1f-4a65-b879-38518c37c0ac tempest-ProjectReaderTests-1344369562 None] Created volume successfully. Nov 03 20:43:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:37 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] Creating offline snapshot d3998fa3-c6c0-45af-950f-507be882902e of volume f64eddf6-ef58-42ca-99ee-56da2accd970 {{(pid=87342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f085bae1-a853-4dae-82ae-f163623c84c0]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Acquiring lock "cinder-cd288c38-9138-4806-b941-3fdbaeb0b506-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Lock "cinder-cd288c38-9138-4806-b941-3fdbaeb0b506-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Acquiring lock "cinder-quobyte-cd288c38-9138-4806-b941-3fdbaeb0b506" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Lock "cinder-quobyte-cd288c38-9138-4806-b941-3fdbaeb0b506" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:38 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 Nov 03 20:43:38 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[293d4ff8-e431-473f-8952-2e2e3f798d6d]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:38 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506 Nov 03 20:43:38 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:38 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970" returned: 0 in 0.366s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e 1G {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:38 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e 1G Nov 03 20:43:38 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:38 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506" returned: 0 in 0.385s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:38 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506 Nov 03 20:43:38 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:38 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-cd288c38-9138-4806-b941-3fdbaeb0b506" returned: 0 in 0.258s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Lock "cinder-quobyte-cd288c38-9138-4806-b941-3fdbaeb0b506" released by "delete_volume" :: held 0.694s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:38 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e 1G" returned: 0 in 0.437s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64eddf6-ef58-42ca-99ee-56da2accd970 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:38 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64eddf6-ef58-42ca-99ee-56da2accd970 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e Nov 03 20:43:38 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Created reservations ['6e6c4b35-9061-44bc-8594-5a6c29cff26c', '6c0b41ec-3faf-438d-bf0a-0fce6fea7319', '4b71894a-a6d7-4481-93a8-d014bd8f430a', '31d09a53-9179-4c12-a83c-5a9d315c1b1e'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:38 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:38 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:38 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:39 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64eddf6-ef58-42ca-99ee-56da2accd970 -F qcow2 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e" returned: 0 in 0.298s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:39 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e is being set with open permissions: ugo+rw Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:39 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e Nov 03 20:43:39 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:39 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.286s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:39 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Deleted volume successfully. Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-ff0c4b63-3a6f-4421-86aa-0f2ecfa1464d tempest-ProjectReaderTests-1344369562 None] Lock "cinder-cd288c38-9138-4806-b941-3fdbaeb0b506-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:39 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e" returned: 0 in 0.256s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:39 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.info Nov 03 20:43:39 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Flow 'volume_create_manager' (12a4f5ae-e44d-4685-80b7-2af54c391247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b0d7b6-955f-46af-ae78-fef20ca360ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:39 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b0d7b6-955f-46af-ae78-fef20ca360ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1396726306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f723a8-1d51-454a-bb53-443d93fbd67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf259bdbd2ae493fa16c814aea6f005e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:40Z,use_quota=True,user_id='efeaecbc1a9b49fbbc7bc52feb0610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5d0968-1b7b-4979-9637-28a98bd9c624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5d0968-1b7b-4979-9637-28a98bd9c624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1529c3e6-09cc-40b1-83ce-aa23f5f28fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1529c3e6-09cc-40b1-83ce-aa23f5f28fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f723a8-1d51-454a-bb53-443d93fbd67d', 'volume_name': 'volume-b3f723a8-1d51-454a-bb53-443d93fbd67d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa7948b-e53b-4942-b916-4c8a7bfb8e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa7948b-e53b-4942-b916-4c8a7bfb8e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f7d8a1-30d8-4387-b68e-7fb01dee4bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:39 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Volume b3f723a8-1d51-454a-bb53-443d93fbd67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f723a8-1d51-454a-bb53-443d93fbd67d', 'volume_size': 1} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.info" returned: 0 in 0.308s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:39 devstack cinder-volume[87342]: WARNING cinder.volume.drivers.remotefs [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.info is being set with open permissions: ugo+rw Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.info {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:39 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.info Nov 03 20:43:39 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:39 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.info" returned: 0 in 0.243s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.264s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1396726306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f723a8-1d51-454a-bb53-443d93fbd67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf259bdbd2ae493fa16c814aea6f005e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:40Z,use_quota=True,user_id='efeaecbc1a9b49fbbc7bc52feb0610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Creating volume b3f723a8-1d51-454a-bb53-443d93fbd67d {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:43:39 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:43:40 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:40 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d 1073741824 Nov 03 20:43:40 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-f1e12c9b-dcfc-405a-9265-ff6032812ef8 tempest-ProjectMemberTests-298078363 None] Create snapshot completed successfully Nov 03 20:43:40 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d 1073741824" returned: 0 in 0.424s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:40 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d Nov 03 20:43:40 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:40 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d" returned: 0 in 0.254s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f7d8a1-30d8-4387-b68e-7fb01dee4bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f723a8-1d51-454a-bb53-443d93fbd67d', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316c3e01-cb11-4ed2-b0bd-08d4d8ef20f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:40 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Volume volume-b3f723a8-1d51-454a-bb53-443d93fbd67d (b3f723a8-1d51-454a-bb53-443d93fbd67d): created successfully Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316c3e01-cb11-4ed2-b0bd-08d4d8ef20f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:40 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Flow 'volume_create_manager' (12a4f5ae-e44d-4685-80b7-2af54c391247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:40 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-090bcbc2-5a8a-4273-a408-ce8548336878 tempest-ProjectReaderTests-1344369562 None] Created volume successfully. Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-d3998fa3-c6c0-45af-950f-507be882902e-delete_snapshot" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-d3998fa3-c6c0-45af-950f-507be882902e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-f64eddf6-ef58-42ca-99ee-56da2accd970" by "delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-f64eddf6-ef58-42ca-99ee-56da2accd970" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-d3998fa3-c6c0-45af-950f-507be882902e" by "_delete_snapshot" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-d3998fa3-c6c0-45af-950f-507be882902e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Deleting offline snapshot d3998fa3-c6c0-45af-950f-507be882902e of volume f64eddf6-ef58-42ca-99ee-56da2accd970 {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] snapshot_file for this snap is: volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e {{(pid=87342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7d7d43-9efa-44ea-988c-0b00639aef14]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:41 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e Nov 03 20:43:41 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:41 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e" returned: 0 in 0.367s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f64eddf6-ef58-42ca-99ee-56da2accd970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c081e847-2f39-44d3-9d8e-cabb079434cc]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Acquiring lock "cinder-b3f723a8-1d51-454a-bb53-443d93fbd67d-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Lock "cinder-b3f723a8-1d51-454a-bb53-443d93fbd67d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Acquiring lock "cinder-quobyte-b3f723a8-1d51-454a-bb53-443d93fbd67d" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Lock "cinder-quobyte-b3f723a8-1d51-454a-bb53-443d93fbd67d" acquired by "delete_volume" :: waited 0.017s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:41 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 Nov 03 20:43:41 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22b412b-1eb2-45a5-8fc8-01649f3db2d5]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:41 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:42 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d Nov 03 20:43:42 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:42 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970" returned: 0 in 0.364s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:42 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e Nov 03 20:43:42 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:42 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d" returned: 0 in 0.373s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:42 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d Nov 03 20:43:42 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:42 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e" returned: 0 in 0.337s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:42 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e Nov 03 20:43:42 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:42 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-b3f723a8-1d51-454a-bb53-443d93fbd67d" returned: 0 in 0.267s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Lock "cinder-quobyte-b3f723a8-1d51-454a-bb53-443d93fbd67d" released by "delete_volume" :: held 0.688s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Created reservations ['6ef71125-9883-4aa6-8d74-45bfd6c92916', '345a9caa-38ce-43d2-9d71-62841563a97d', '6ec05af3-a21b-45da-a8af-62cee508ce59', 'b1a8a1ff-854d-48b3-82f3-2d7c8b83c02b'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:42 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:42 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:42 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970.d3998fa3-c6c0-45af-950f-507be882902e" returned: 0 in 0.264s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-d3998fa3-c6c0-45af-950f-507be882902e" released by "_delete_snapshot" :: held 1.451s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-f64eddf6-ef58-42ca-99ee-56da2accd970" released by "delete_snapshot" :: held 1.480s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Created reservations ['86a0e686-54ff-4baa-93a8-f3bff49cab24', 'd72b60d6-3064-4c9e-9e67-d2ff1383be19', '8870f57d-7438-468f-9094-59720b765012', '9a1fe5eb-3c7d-4923-996c-ecfc423a4d39'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Delete snapshot completed successfully. Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-b8281271-7572-49b9-88d7-341d409634b7 tempest-ProjectMemberTests-298078363 None] Lock "cinder-d3998fa3-c6c0-45af-950f-507be882902e-delete_snapshot" released by "delete_snapshot" :: held 1.635s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:42 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.259s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:42 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Deleted volume successfully. Nov 03 20:43:42 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-369abfcf-5ae1-455c-aeaf-97031817e59c tempest-ProjectReaderTests-1344369562 None] Lock "cinder-b3f723a8-1d51-454a-bb53-443d93fbd67d-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Flow 'volume_create_manager' (82488c47-5180-46ca-9420-213619d97620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9513d15-2d55-4b00-be9c-3e9e975e1181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-f64eddf6-ef58-42ca-99ee-56da2accd970-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9513d15-2d55-4b00-be9c-3e9e975e1181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482215894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82730d1b-06c7-4959-b758-df5709b9b23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf259bdbd2ae493fa16c814aea6f005e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:43Z,use_quota=True,user_id='efeaecbc1a9b49fbbc7bc52feb0610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4197749-4d7f-4bcd-8ab6-ccc2a170dffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4197749-4d7f-4bcd-8ab6-ccc2a170dffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f1e7b3-8178-4af2-ba15-d1717f34d42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f1e7b3-8178-4af2-ba15-d1717f34d42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82730d1b-06c7-4959-b758-df5709b9b23a', 'volume_name': 'volume-82730d1b-06c7-4959-b758-df5709b9b23a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54885b5c-434c-47f9-9fc3-e4337bba4db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54885b5c-434c-47f9-9fc3-e4337bba4db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16da98e1-8d6f-47b8-8c16-46fef6345fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:43 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Volume 82730d1b-06c7-4959-b758-df5709b9b23a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82730d1b-06c7-4959-b758-df5709b9b23a', 'volume_size': 1} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482215894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82730d1b-06c7-4959-b758-df5709b9b23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf259bdbd2ae493fa16c814aea6f005e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:43Z,use_quota=True,user_id='efeaecbc1a9b49fbbc7bc52feb0610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Creating volume 82730d1b-06c7-4959-b758-df5709b9b23a {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:43:43 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Lock "cinder-f64eddf6-ef58-42ca-99ee-56da2accd970-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:43 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a 1073741824 Nov 03 20:43:43 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Acquiring lock "cinder-quobyte-f64eddf6-ef58-42ca-99ee-56da2accd970" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-f64eddf6-ef58-42ca-99ee-56da2accd970" acquired by "delete_volume" :: waited 0.016s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8515c7-005f-459c-a139-07557eb0f7dd]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:43 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 Nov 03 20:43:43 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:43 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a 1073741824" returned: 0 in 0.445s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:43 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:44 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a Nov 03 20:43:44 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:44 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970" returned: 0 in 0.396s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:44 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970 Nov 03 20:43:44 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:44 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a" returned: 0 in 0.261s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16da98e1-8d6f-47b8-8c16-46fef6345fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82730d1b-06c7-4959-b758-df5709b9b23a', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d974ace9-3582-4901-b361-520192d0c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:44 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Volume volume-82730d1b-06c7-4959-b758-df5709b9b23a (82730d1b-06c7-4959-b758-df5709b9b23a): created successfully Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d974ace9-3582-4901-b361-520192d0c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Flow 'volume_create_manager' (82488c47-5180-46ca-9420-213619d97620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:44 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-f64eddf6-ef58-42ca-99ee-56da2accd970" returned: 0 in 0.284s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-ea16ce2f-17ec-483f-8412-873463f40ad9 tempest-ProjectReaderTests-1344369562 None] Created volume successfully. Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Lock "cinder-quobyte-f64eddf6-ef58-42ca-99ee-56da2accd970" released by "delete_volume" :: held 0.748s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Created reservations ['7bf204be-0391-430b-9ac1-d39f2c3e3643', 'b9ca26ad-e4b0-4d63-a25d-405a9b2c29c0', '8ce54c07-fc6d-493d-8e73-6d10f54c0221', 'd787bc41-f3dc-4305-a330-3f7f36571274'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:44 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:44 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Acquiring lock "cinder-82730d1b-06c7-4959-b758-df5709b9b23a-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Lock "cinder-82730d1b-06c7-4959-b758-df5709b9b23a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Acquiring lock "cinder-quobyte-82730d1b-06c7-4959-b758-df5709b9b23a" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Lock "cinder-quobyte-82730d1b-06c7-4959-b758-df5709b9b23a" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1948c8ae-00f4-438a-90f9-42ee6c3c9e30]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:44 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a Nov 03 20:43:44 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:44 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.293s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:44 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Deleted volume successfully. Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-16ccfbae-63d9-4994-a400-9f98dfc5c925 tempest-ProjectMemberTests-298078363 None] Lock "cinder-f64eddf6-ef58-42ca-99ee-56da2accd970-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:44 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a" returned: 0 in 0.378s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:44 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:45 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a Nov 03 20:43:45 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:45 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-82730d1b-06c7-4959-b758-df5709b9b23a" returned: 0 in 0.256s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Lock "cinder-quobyte-82730d1b-06c7-4959-b758-df5709b9b23a" released by "delete_volume" :: held 0.696s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Created reservations ['3b52a866-c27b-4d20-baa7-badbdd86ec0c', 'ecbb76f5-3ba9-4314-a0a7-e849ceb79ddf', 'e6da0c88-9018-4819-91e0-5809015260c8', '506d7d94-69fd-4f26-b77c-0c0a8e15206d'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:45 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:45 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:45 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.258s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:45 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Deleted volume successfully. Nov 03 20:43:45 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-a57ce2e3-9334-4264-8622-492053d3b271 tempest-ProjectReaderTests-1344369562 None] Lock "cinder-82730d1b-06c7-4959-b758-df5709b9b23a-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Flow 'volume_create_manager' (cc52850d-a8fd-4e6f-9859-212437c1055a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65deec48-7fbf-467e-bb74-28a6973579b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65deec48-7fbf-467e-bb74-28a6973579b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1900363417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6352654-f73c-4180-b743-6d13f64c76f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf259bdbd2ae493fa16c814aea6f005e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:46Z,use_quota=True,user_id='efeaecbc1a9b49fbbc7bc52feb0610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15102ce-1453-43bf-8ea9-3b3922fdad3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15102ce-1453-43bf-8ea9-3b3922fdad3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335328f6-15cf-4931-9f6d-c9e6f4573dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335328f6-15cf-4931-9f6d-c9e6f4573dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6352654-f73c-4180-b743-6d13f64c76f8', 'volume_name': 'volume-a6352654-f73c-4180-b743-6d13f64c76f8', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9fafa9-8942-4cb4-a595-4fc8892fd131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9fafa9-8942-4cb4-a595-4fc8892fd131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597f90b2-4367-46b4-a61f-56f22ff04080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:46 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Volume a6352654-f73c-4180-b743-6d13f64c76f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6352654-f73c-4180-b743-6d13f64c76f8', 'volume_size': 1} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1900363417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6352654-f73c-4180-b743-6d13f64c76f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf259bdbd2ae493fa16c814aea6f005e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:43:46Z,use_quota=True,user_id='efeaecbc1a9b49fbbc7bc52feb0610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c7695c-3152-4526-8136-3b0b414435dc),volume_type_id=62c7695c-3152-4526-8136-3b0b414435dc)}" {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.remotefs [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Creating volume a6352654-f73c-4180-b743-6d13f64c76f8 {{(pid=87342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Selected osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb as target Quobyte volume. {{(pid=87342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:43:46 devstack cinder-volume[87342]: INFO cinder.volume.drivers.remotefs [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] casted to osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8 1073741824 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:46 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8 1073741824 Nov 03 20:43:46 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:46 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8 1073741824" returned: 0 in 0.441s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:46 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8 Nov 03 20:43:46 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:46 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8" returned: 0 in 0.256s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'} {{(pid=87342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:43:46 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597f90b2-4367-46b4-a61f-56f22ff04080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6352654-f73c-4180-b743-6d13f64c76f8', 'volume_size': 1}' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423ccb26-5023-46f1-a23e-298d0b0b9594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:43:47 devstack cinder-volume[87342]: INFO cinder.volume.flows.manager.create_volume [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Volume volume-a6352654-f73c-4180-b743-6d13f64c76f8 (a6352654-f73c-4180-b743-6d13f64c76f8): created successfully Nov 03 20:43:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423ccb26-5023-46f1-a23e-298d0b0b9594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87342) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:43:47 devstack cinder-volume[87342]: DEBUG cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Flow 'volume_create_manager' (cc52850d-a8fd-4e6f-9859-212437c1055a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87342) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:43:47 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-63d1501c-e62f-4ecf-819e-4fa777caeed8 tempest-ProjectReaderTests-1344369562 None] Created volume successfully. Nov 03 20:43:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Acquiring lock "cinder-a6352654-f73c-4180-b743-6d13f64c76f8-delete_volume" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Lock "cinder-a6352654-f73c-4180-b743-6d13f64c76f8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Acquiring lock "cinder-quobyte-a6352654-f73c-4180-b743-6d13f64c76f8" by "delete_volume" {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:43:48 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Lock "cinder-quobyte-a6352654-f73c-4180-b743-6d13f64c76f8" acquired by "delete_volume" :: waited 0.019s {{(pid=87342) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:43:48 devstack cinder-volume[87342]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bf0503-07bd-4e72-9c07-3426cd2db41e]: (4, 'qcow2') {{(pid=88948) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:43:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:48 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8 Nov 03 20:43:48 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:48 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8" returned: 0 in 0.385s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:48 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:48 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8 Nov 03 20:43:48 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:49 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078/volume-a6352654-f73c-4180-b743-6d13f64c76f8" returned: 0 in 0.262s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Lock "cinder-quobyte-a6352654-f73c-4180-b743-6d13f64c76f8" released by "delete_volume" :: held 0.702s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG cinder.quota [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Created reservations ['75f0fc6e-7b84-4b18-ac07-537b5d038eaa', '9c0f0703-1654-4b38-9d6c-14d039d6e6cd', 'e1196510-f29a-4963-8c61-65f9562a318b', 'f6847b6c-8004-4258-b91e-645bb70f17d1'] {{(pid=87342) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb': None} {{(pid=87342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG cinder.volume.drivers.quobyte [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79a55e31-f5bb-4ad1-8b1d-3b5d5da7c0fb'] {{(pid=87342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.lockutils [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87342) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:43:49 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078 Nov 03 20:43:49 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:43:49 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG oslo_concurrency.processutils [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/835437689367a02286e93816b72ec078" returned: 0 in 0.277s {{(pid=87342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG cinder.manager [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Notifying Schedulers of capabilities ... {{(pid=87342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:43:49 devstack cinder-volume[87342]: INFO cinder.volume.manager [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Deleted volume successfully. Nov 03 20:43:49 devstack cinder-volume[87342]: DEBUG cinder.coordination [None req-63e6e4da-7011-4a2b-acbb-1b9478f45b2f tempest-ProjectReaderTests-1344369562 None] Lock "cinder-a6352654-f73c-4180-b743-6d13f64c76f8-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87342) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:43:59 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:SELECT=99,cinder:INSERT=36,cinder:UPDATE=147,cinder:DELETE=10 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:43:59 devstack cinder-volume[87342]: DEBUG dbcounter [-] [87342] Writing DB stats cinder:UPDATE=125,cinder:DELETE=12,cinder:INSERT=36,cinder:SELECT=96 {{(pid=87342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}